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IN SITU METHOD OF ANALYZING CELLS 

FIELD AND BACKGROUND OF THE INVENTION 

The present invention relates to in situ analysis of cells and, more 
particularly, to simultaneous in situ analysis of a plurality of 
immunohistochemical stains, histological stains and/or DNA ploidy stains using 
spectral imaging techniques, which enable high spatial resolution as well as 
spectral resolution. 

Over the past ten to fifteen years, immunohistochemistry (IHC), which is 
also known as immunocytochemistry (ICC) when applied to cells.^ h 3S become an 
indispensable tool in diagnostic pathology and has virtually revolutionized the 
practice of surgical pathology. The terms immunohistochemistry and 
immunocytochemistry are used herein interchangeably. Panels of monoclonal 
antibodies can be used in the differential diagnosis of undifferentiated neoplasms 
(e.g., to distinguish lymphomas, carcinomas, and sarcomas); to reveal markers 
specific for certain tumor types; to diagnose and phenotype malignant 
lymphomas; and to demonstrate the presence of viral antigens, oncoproteins, 
hormone receptors, and proliferation-associated nuclear proteins. Not only do 
such markers have diagnostic significance, but there is a growing body of 
evidence that some tumor markers have prognostic significance, as has been most 
extensively demonstrated in breast cancer. These marker studies can be 
performed by IHC on a variety of specimen types, including cytological 
preparations, paraffin-embedded tissue, and frozen sections. Most clinical assays 
employ a single antibody for each slide but by using chromogens of different 
colors, it is possible to observe/demonstrate two or more markers simultaneously. 
However, without the use of equipment for processing the appropriate spectral 
resolution the qualitative or quantitative detection of these chromogens is 
difficult due to the fact that their absorption coefficients spectrally overlap. 

For most applications of IHC, qualitative assessment of the staining 
patterns is sufficient, because it is the overall staining pattern of the tissue and the 
cells of interest that imparts the diagnostic informafion. The human visual 
system is quite adept at such pattern-recognition tasks, which can be performed 
quite rapidly, although subjectively. However, the human eye or a CCD camera 



Mippressor gene products (e.g., p53). chemotherapy resistance factors, tumor 
angionenesis, !\ mphocvte subset analysis, etc. 
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The general goal of quantitative IHC (QIHC) is to provide objective 
measurements of immunostaining reactions. These measurement^ may be useful 
in data collection for experimental purposes, but the greatest potential of such 
measurements lies in exploring their use as aids for determining diagnosis, 
prognosis, or therapy of human disease, especially cancer. Aside from the 
mechanics of making such measurements, which will be discussed, a number of 
issues are related to the peculiarities of IHC which potentially affect how the 
measurements should be made. 

Many of the biological markers detected by IHC do not exhibit a simple 
"all-oi-iioue" type of expression, and the cellular populations being studied may 
exhibit considerable heterogeneity with regard to positivity and degree of 
staining. The localization of the staining reaction may also be important, because 
some antigens can be expressed on the plasma membrane, in the cytoplasm, or in 
the ceil nucleus. Therefore, both the distribution of the marker among the cell 
populations and subcellular localization need to be taken into account. 

Unlike immunostaining using directly fluoresceinated antibodies, in which 
the degree of staining is related to ligand concentration in a linear fashion, IHC is 
in theory nonlinear for two reasons: (i) the enzyme reaction forming the 
precipitation reaction product is nonlinear, and (ii) a variety of amplification 
strategies are typically employed, using either bridging or complexing reagents, 
the goal being to increase the staining sensitivity. The result is that the amount of 
antigen cannot be directly calculated from the intensity of the 
immunohistochemical staining. In addition, there may be substantial day-to-day 
variation in the quality of immunostaining, although automation of the staining 
procedure may provide more consistency than is usually obtained using manual 
methods. 

Some studies, however, do indicate that under certain conditions it may be 
possible to establish a linear relationship between ligand concentration and 
degree of immunohistochemical staining, mostly demonstrated using model 
systems [van der Ploeg M, Duijndam WAL. Matrix models: Essential tools for 
microscopic histochemical research. Histochemistry 1986; 84:283]. It has been 
suggested that the biotin-avidin method of staining may be less suitable for this 



:Mc\ L'ns M, dc Mcincn W llcnquin J-C. Determination of antigen concentration 
m tissue sections by immunodensitometr>'. Lab Invest !989;61 :357-363 ]. 
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excellent correlation between radioimmunoassay and QIHC using image analysis. 
They make the important observation that using lower concentrations of antibody 
is key to the success of the method, because higher concentrations of antibody 
failed to exhibit a linear relationship with insulin content. They also point out 
5 that higher concentrations of antibody should be used when the goal of the 
measurement is to detect all cells containing the antigen of interest, regardless of 
level. However, even higher spectral sensitivity is required when working at 
lower level of antibody, especially if multiple antibodies are to be simultaneously 
employed. 

10 It is clear that any attempt to quantitate the intensity of immunostaining 

requires the use of calibration standards, possibly cell lines expressing known 
levels of antigen or some kind of internal reference. These problems need to be 
addressed in each application of QIHC. 

The approach that has been used most commonly in QIHC relies on the 

15 measurement of population statistics, such as tlie percent of positively stained 
cells, rather than absolute biochemical concentration of the target molecules. 
This approach is analogous to that used in clmical flow cytometry, where the 
proportion of a cell population expressing a given surface marker, rather than the 
level of expression of that marker, is most commonly measured. 

20 For many of the markers of interest, such an approach makes a great deal 

of sense biologically. For example, if one is interested in the expression of cell 
cycle-related markers, it is the proportion of cells expressing that marker, rather 
than the absolute level of expression, which provides information about the 
proliferative fraction, 

25 For some markers, such as hormone receptor measurement in breast 

cancer, the standard methods have provided a biochemical determination 
expressed as concentration. However, tumors may exhibit striking heterogeneity 
with regard to expression of these molecules, and measurements that reflect this 
heterogeneity may provide infomiation that is more biologically relevant. After 

30 all, two tumors may exhibit identical biochemical levels of a given molecule and 
yet have very different proportions of tumor cells that actually express any level 
at all. This problem is perhaps best illustrated with regard to estrogen receptor 



iinagmg incihods. The ic\cls t)r inimunostainmg (signal) must he detectable 
above the background (noise), and should be distinguishable from other cellular 
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antibodies (primary and secondary) to maximize the specific staining and 
minimize the background staining. The tissues are visualized usi'ng histological 
stains (also known as counterstains) having a different color than the chromogen, 
so that the staining reaction can be easily visualized. For example, 
immunoperoxidase reactions, which yield a brown reaction product, are typically 
combined with methyl green or toluidine blue histological stains (counterstains) 
to provide visual contrast. However, when multiple immunohistochemical stains 
of different label are used in combination with histological stains and/or DNA 
ploidy stains it is advantageous to be able to distinguish among the marker stains 
themselves and to turther distinguish between the different stains used for 
counterstaining or for examination of DNA ploidy, such that each spectral 
component is identifiable independently of the other spectral components. This 
cannot be achieved according to any of the methods known in the prior art. 

Although some image analysis systems employ true color analysis to 
measure specific regions of the color spectrum, most imaging systems are based 
on a gray scale (black and white) light measurements, and depend on optical 
filters to select specific wavelengths of light for measurement. Combinations of 
stains that show minimal spectral overlap are presently most useful for QIHC. 
However, a system witli increased spectral resolution will enable the use of 
highly overlapping dyes. 

The CAS 200 System (Cell Analysis Systems, Inc., Lombard, III), 
employs two video cameras, one coupled with a 500 nm bandpass filter and the 
other with a 650 nm filter. Tissues are immunostained using the 
immunoperoxidase method with diaminobenzidine (DAB) as the chromogen 
(brown reaction product) and methyl green as the tissue (nuclear) counterstain. 
Images of the nuclei of all of the cells in the field are captured by one camera 
using the 650 nm filter, while the other camera captures images of the brown 
reaction product at 500 nm, a wavelength at which DAB is maximally 
transmitted and methyl green is absorbed. The optical density of the reaction 
product can be determined by converting the light transmission (gray level) to 
optical density using a calibrated look-up table, and the relative area of the 
staining reaction (expressed as a percent of the area stained by methyl green) can 



-rccn ana DAB may be used, restricted only by the spectral o\erlap of the 
reagents and the availability of suitable filter combinations. This system, 
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overlapping spectral components. A system with a higher spectral resolution 
would enable to simultaneously detect a plurality of spectral components, with 
higher spectral overlap thereamongst. 

No standards have yet been established in the field of QIHC with regard to 

5 instrumentation, computer algorithms, staining methodology, or performance 
characteristics (precision, reproducibility) [Wells WA, Rainer RO, Memoli VA. 
Equipment, standardization, and applications of image processing. Am J Clin 
Pathol 1993; 99:48-56]. Such standardization has been difficult to achieve in 
another technically related area, flow cytometry, although there has been progress 

10 [Muirhead KA. Establishment of quality control procedures in clinical flow 
cytometry. Ann N Y Acad Sci 1993; 677:1-20; and National Committee for 
Clinical Laboratory Standards. Clinical applications of flow cytometry: Quality 
assurance and immunophenotyping of peripheral blood lymphocytes: tentative 
guideline. Villanova: NCCLS; 1992; NCCLS document H42-T (ISBN 1-56238- 

15 15.5-5)]. Standardization issues important for clinical laboratory testing, 
including the precise antibodies and chromogens to be used, the number of fields 
and tissue sections to be measured, the units used to report results, quality control 
materials, and instrument calibration have not yet been resolved for QIHC. As 
will become apparent to the reader, the present invention provides a giant step 

20 towards such standardization. 

There is a growing body of evidence that tumor cell proliferation has 
prognostic significance for a variety of commonly occurring malignancies, 
including lymphoma [Braylan RC, Diamond LW, Powell ML, Harty-Golder B. 
Percentage of cells in the S phase of the cell cycle in human lymphoma 

25 determined by flow cytometry: Correlation with labeling index and patient 
survival. Cytometry 1980; 1:171-174; and Bauer KD, Merkel DE, Winter JN, et 
al. Prognostic implications of ploidy and proliferative activity in diffuse large 
cell lymphomas. Cancer Res 1986; 46:3173-3178], breast cancer [Clark GM, 
Dressier LG, Owens MA, Pounds G, Oldaker T, McGuire WL. Prediction of 

30 relapse or survival in patients with node-negative breast cancer by DNA flow 
cytometry. Engl J Med 1989; 320:627-633; Silvestrini R, Daidone MG, 
Gasparini G. Cell kinetics as a prognostic marker in node-negative breast cancer. 



cil, l^rognostic implications of proliferative acti\it\' and DNA ancuploiciy in 
colonic adenocarcinomas. Lab Invest 1987; 57:329-335]. In some studies, tumor 

11 i r--^'' 1 ■- ■ • I . 
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content analysis ("ploidy") does not [Visscher DW, Zarbo RJ, Greenawald KA, 
Crissman JD. Prognostic significance of morphological parameters and flow 
cytometric DNA analysis in carcinoma of the breast. Pathol Ann 1990; 25(Part- 
I): 171-210]. 

5 Mitotic counts are generally regarded as a poor and unreliable measure of 

proliferation; yet they require no special preparative methods. 

Uptake of radiolabeled thymidine, or "thymidine labeling index" (TLI) is a 
well-established method and is considered by many to be the "gold standard" for 
measuring tumor cell kinetics. Although the TLI provides an accurate assessment 

10 of S-phase activity and permits histologic correlation, the method is cumbersome 
and not easily adapted to the clinical laboratory. 

Flow cytometry (FCM) has been used extensively to determine cell cycle 
activity, primarily by quantitation of the S-phase portion of the DNA content 
analysis ("ploidy"). This method suffers from a number of serious technical 

15 limitations, however. First, it may be difficult to obtain single cell suspensions 
from solid tumors, and variable numbers of tumor cells may be lost during 
preparation. Second, the tumor cells are variably diluted by benign normal and 
inflammatory cells, which can lead to underestimation of the S-phase fraction, 
particularly for DNA diploid tumors. Third, the complexity of the DNA content 

20 analysis ("ploidy"), which consists of a series of overlapping curves, may 
preclude the accurate use of curve-fitting algorithms to measure the S-phase 
portion of the histogram. Multicenter studies have shown poor reproducibility 
for flow-cytometric S-phase fraction, making the practical clinical usefulness of 
the measurement somewhat doubtful. Another problem associated with cell 

25 kinetic measurement by flow cytometr)' is that only the S-phase fraction is 
typically detennined, whereas a significant proportion of the tumor cell 
population may reside in the Gj phase of the cell cycle, comprised of cells 
committed to entering the cycle but not yet synthesizing DNA. Conceivably, Uvo 
tumors may have identical S-phase fractions but differ significantly in the total 

30 fraction of cells in the nonresting state, and thus may exhibit different growth 
kinetics and response to cycle-dependent chemotherapeutic agents. 

For all of these reasons, in situ methods of tumor cell cycle analysis may 



.xion^etry Principles una applications. Baltimore: Williams and Wllkins; 
1992:359-372: and Weinberg DS. Proliferation indices in solid tumors. Adv 
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measurements are made specifically on the tumor cells, in situ methods can allow 
more widespread sampling of the tumor and determination of tumor cell 
heterogeneity. 

The quantitation of nuclear DNA is increasingly coming into practice in 
5 both research and clinical applications. 

The measurement of DNA content by either flow or image cytometry is 
based on the assumptions that the amount of stain represents the amount of DNA 
and that this amount of stain is correctly measured by the instrument. These 
assumptions would imply that (i) the DNA labelling procedure (fluorescent dye, 
10 chromogenic reaction or staining) is specific (all DNA is labelled and only 
DNA), stoichiometric (staining intensity changes proportionally to DNA content) 
and stable (staining intensity does not change with time or repeated 
measurements); (ii) the instrument used to measure either the light emitted by the 
fluorescent dye or absorbed by the stain is accurate (giving a result close to the 
15 true amount of stain) and reproducible (giving very similar measurements when 
repeated on the same nucleus), even though not close to the true amount of stain, 
and linear (giving a result that is perfectly proportional to the amount of stain). 

Unfortunately, both the staining procedures and prior art instruments have 
well-known limitations such that the final measurement is not representative of 
20 the absolute amount of DNA actually present in a nucleus. 

While stoichiometry can easily be verified by routine controls, the 
specificity is not accessible because there is no alternative method for the 
cytometric measurement of DNA content at the individual cell level. 

For example, (i) very specific fluorescent dyes bind to either G-C (e.g., 
25 mithramycin, chromycin A3) or A-T (e.g., Hoechst, DAPI) DNA base pairs and 
thus detect the DNA only partially and generate measurements that depend on 
base pair sequences; (ii) the chromogenic reactions, like Feuigen, involve an acid 
hydrolysis that removes some DNA fragments as rapidly as they are released 
from the decondensed chromatin. These reactions thus detect the DNA only 
30 partially and provide measurements that depend on the euchromatin versus 
heterochromatin balance; (iii) the fixative medium may impair or facilitate further 
hydrolysis, depending on the way they interact with histones. 

\hc case tor heavily stained heterochromatin; (ii) the distribution of the dye is not 
spatially homogeneous and thus introduces a distributional error that increases as 
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absorption coefficient of a dye varies with the wavelength of light so that the 
densitometric calculation only applies for monochromatic light. Since they do not 
deliver enough intensity for visual observation (unless combined with huge arc 
lamps), monochromators are not used in routine image cytometry, but filter are 

5 used whose centre on the maximum absorption is ±10 nm, which usually varies 
from one system to another. 

In addition to the above considerations, the preparation and the prior art 
instruments employed are optical compromises and are thus responsible for 
reflection, refraction and diffraction due to the glass slide, mounting medium, 

)0 lenses and prisms. Uie light not following the expected geometrical pathways 
contributes to glare, also called Schwarzchild - Villiger effect, which distorts the 
ratio between the light beam intensity incident to the nucleus and that emerging 
from the specimen. Therefore, all the pixel ODs calculated are slightly 
erroneous. This error increases as the optical field size increases. The use of a 

15 high-quality microscope is thus mandatory to decrease this systematic error of 
densitometric measurements, which is the most important factor contributing to 
variations of image cytometry measurements. 

Also, video cameras are sensitive to vibrations and electromagnetic fields, 
image afterglov/ and saturation-all factors contributing to the distortion of the 

20 signal before digitization. At present, charge-coupled device (CCD) cameras 
undoubtedly provide the most reproducible results as far as densitometry is 
concerned. 

The above limitations all contribute to negative errors that have been 
extensively investigated. It is thus obvious that the true cell DNA content is not 

25 accessible to cytometric measurements. It is therefore astounding that some 
commercially available image cytometry systems provide measurements 
expressed in picograms DNA per nucleus, thus adding to the general confusion 
and, in addition, deliberately misleading the clinicians using such systems. 

Provided the staining and measuring procedures are correctly performed 

30 and controlled, the quantitation of DNA-specific stains can be interpreted in 
terms of overall proliferative activity and gross cytogenetic aberrations, thus 
giving a clear indication as to how to proceed further in investigating those 



:i)cin has gathered world-wide acceptance tor DNA c\tophotomctn\ and this is 
the reaction named after Feulgen and Rossenbeck, often simply named Feulgen 
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reaction. Terms like Feulgen stain and Feulgen reaction is presently the only 
staining technique which is stoichiometric for DNA, which means that staining of 
DNA is both quantitative and specific. All the other methods mentioned in Table 
1 are quantitative but not specific for DNA. The success of the Feulgen reaction 
for quantitative DNA staining is certainly based on this uniqueness. 

The Feulgen reaction is a complicated cytohistochemical method which 
consists of various preparatory steps. Principally, the reaction starts with a 
procedure called acid hydrolysis: slides with the fixed cytological material are 
immersed in hydrochloric acid (HCl) which splits off the purine bases adenine 
and guanine from the DNA molecule, thereby generating aldehyde groups in the 
purine-firee DNA molecule, which is then called apurinic acid (APA). In a second 
step, the slides are immersed in Schiffs reagent containing a dye which binds 
covalently to the aldehyde groups. After removal of surplus dye the slides are 
dehydrated and mounted as usual. In correctly stained material, cell nuclei are 
stained red-violet, and the cytoplasm and background are unstained. The various 
steps of the Feulgen reaction become critical when they must be standardized to 
achieve good reproducibility of staining performance. Therefore, a discussion of 
the relevant preparatory steps must consider potential sources of error. 



TABLE 1 
Quantitative DNA stains (+, yes; no) 



Staining procedures Quantitative Stoichiometric 
Feulgen reaction + + 
(basic fuchsin) 

Feulgen reaction + -\- 
plus 

Anionic counterstain + 

Thionin, Feulgen + + 

Thionin, Feulgen + + 

plus 

Anionic counterstain 

Gallocyanin + / 

chromalum 

Methvl 
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Routinely, HCl is used for acid hydrolysis, but in principle any acid is 
suitable. The acid has two effects on the DNA molecules: (i) removal of purine 
bases, which generates aldehyde groups in the DNA molecules; and (ii) 
depolymerization of the large APA molecules into smaller fragments. These 

5 fragments are partly removed from the cell nuclei by diffusion into the acid 
solution. Generation of aldehyde groups leads to an increase in nuclear staining 
intensity, whereas the loss of APA fragments leads to a loss of stainable material 
from the cell nucleus and thus to a decrease of staining intensity. Thus, we have 
two counter-current chemical reactions, each following specific and complicated 

iO kinetics, the resulting reaction curve is called the hydrolysis profile or the 
hydrolysis curve. 

This hydrolysis profile can be subdivided into four phases: (i) increase of 
staining intensity; (ii) peak phase with maximum staining intensity; (iii) plateau 
phase with constant staining intensity; and (iv) decrease in staining intensity. 

15 Phase (i) is characterized by continuous generation of aldehyde groups. 

The loss of APA fragments is minimal in the beginning, and the amount of 
stainable material in the cell nucleus increases constantly until phase (ii) is 
reached. The peak can be so short that it is sometimes hardly visible in 
hydrolysis profiles. During the plateau phase, (iii), one finds a balance between 

20 the continuous generation of aldehyde groups and the loss of APA fragments, and 
consequently, the staining intensity remains constant over a certain period of 
time. In phase (iv) the loss of APA fragments outruns the generation of new 
aldehyde groups, and the staining intensity decreases. After prolonged hydrolysis 
we find the generation of the maximum number of aldehyde groups, but all APA 

25 fragments have been removed from the cell nucleus, and staining intensity is 
zero. 

In practice, it is important to stop acid hydrolysis during phase (iii) where 
smaller variations of the hydrolysis time have virtually no influence on staining 
intensity. 

30 The shape of the hydrolysis curve is influenced by several factors, only 

some of which can be standardized. 

Highly condensed DNA is less sensitive to acid hydrolysis than 



;^:cparaiion techniques such a^ specimen sampling and espccialh' fixation of the 
material may artificially influence DNA compactness and thus acid scnsitivirv'. 
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A high temperature of the acid bath shortens all four phases. Phase (iii) 
may be as short as only a few seconds, and a prominent plateau may not be 
detectable. If hydrolysis is topped in the very steep phases (i) or (iv), even 
minimal variations of processing time lead to considerable variations in staining. 

5 Short hydrolysis profiles with an extremely short peak phase are usually found 
with so-called hot hydrolysis techniques using an acid bath at 60 °C, and 
frequently it is impossible to stop hydrolysis at the right moment, namely in phase 
(iii). More frequently, cold hydrolysis with 4-5 mol/1 HCl is performed at about 
22 °C where under routine conditions the plateau phase has a length of several 

10 minutes. Acid hydrolysis is then stopped by a short rinse of the slide in tap water. 

Various additives to the acid bath have been recommended in the 
literature, these should minimize the loss of APA fragments from the cell 
nucleus. These additives, however, do not play an important role for practical 
purposes. 

!5 Schiffs reagent is a colourless aqueous reagent which contains a dye 

mixture called basic fuchsin. Basic fuchsin is normally composed of four 
cationic triarylmehine dyes pararosanilin and its methylated homologues 
rosanilin, magenta II and new fuchsin. Basic fuchsin of high quality contains a 
high proportion of pararosanilin. Schiffs reagent is colourless because the 

20 relevant dyes are present in their leucoform with sulphite bound to the dye 
molecules. Coloration of Schiffs reagent (based on basic fuchsin) proves loss of 
sulphite and deterioration of the solution, which should then be discarded. 
Various substitutes for basic fuchsin have been recommended, among them the 
thiazine dye thionin. The advantage of thionin is that it stains cell nuclei blue, a 

25 color the cystologists and pathologists are used to when they want to check the 
slide visually), and cytopUasmic counterstaining with eosin Y or Congo red is 
easily feasible. Schiffs reagent based on thionin is usually not completely 
colourless. 

After staining with the Schiffs reagent the material is rinsed in dye-free 
30 sulphite water. The sulphite removes surplus dye from the cell nuclei and 
c}loplasm, and only the covalently bound dye molecules stay fixed to the APA 
molecules within the cell nucleus. The background of the slide should be 
completelv unstained when the Feiilgen rrr^rtion h^^ hnm norfr>r->..^ j .t, 

^I'^^i-ii.i Jia\c iii: ;>LjitanR: iiuuar curiLcnirat ion at the rigiil temperature 
(e.g., 5 mol/1 HCl at 22 °C or 4.0 mol/1 HCl at 27.5 °C). Acid of suitable molar 
strength is commercially available or can ca^iK' be i^repared ff'^^v r,-^T— iM^r'^t-n 
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HCl, Frequently, HCl stored in the refrigerator at 4 °C is used immediately 
without waiting for the acid to warm up; this leads to retardation of the hydrolic 
reaction, which is often stopped before the plateau phase is reached. The use of 
temperature-controlled water baths is recommended. Where this is not feasible, 
5 scrupulous measurement of the temperature of the acid solution helps to avoid 
erroneous photometric results. 

It is of utmost importance to note that changing the fixative may influence 
the hydrolysis profile dramatically (by changing chromatin compactness and thus 
acid sensitivity of the DNA). Changing the fixative means that the hydrolysis 

10 curve has to be re evaluated. Therefoic, it seems a good recommendation to stick 
to one staining protocol which has been established in the relevant laboratory and 
was found to give reliable and consistent staining results. 

The staining procedure itself is uncritical. Staining should be carried out 
for at least 45 minutes to give the reaction sufficient time to be completed. 

15 Schiffs reagent of high and consistent quality is commercially available. 

Gallocyanin cromalum (GCA) is a cationic oxadine dye which forms 
complexes with metals. GCA stains DNA and RNA quantitatively. Thus, it is 
not specific for DNA. Photometric determination of DNA requires either 
photometric correction for stained RNA or enzymatic or hydrolytic removal of 

20 RNA. The Einarson GCA staining protocol prescribes staining times of up to 48 
hours at elevated temperature which makes it impossible to use for routine 
cytology. A modified GCA was proposed by Husain and Watts with staining 
times of about 15 minutes. 

As compared with Feulgen, GCA after Husain and Watts has the 
25 following advantages: (i) no acid bath; (ii) staining time only 15 min; and (iii) 
gray-blue cell nuclei. The disadvantages are: (i) not specific for DNA; (ii) 
background staining (due to RNA); and (iii) short shclf-life of the staining 
solution (about 6 weeks). Specificity of staining can be improved by mild 
hydrolysis (1 mol/1 HCl at 22 X for 10 minutes) which removes RNA but not 
30 DNA. Anionic counterstaining is possible without loss of GCA from the stained 
DNA. 

GCA stains both wet and dry fixed material Dry fixed slides are 



...;>LtM (. iM:U) arc used, Uic I'Ld iilm on ihc allele has to be rcinovcci prior to 
staining by washing the slide for 5 minutes in cthanol 99 % (v'v). 
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Both techniques - the Feulgen reaction and GCA - are equally suitable for 
cytophotometric determination of DNA. However, they give completely different 
results when the texture of nuclear chromatin is measured at high optical 
resolution: acid hydrolysis changes the chromatin structure dramatically, and the 
5 chromatin texture of Feulgen-stained cell nuclei is absolutely different from the 
texture of GCA-stained material. 

GCA is all in all less critical than the Feulgen reaction and easier to 
perform. Nevertheless, the authors prefer the Feulgen reaction due to its substrate 
specificity and the stability of the staining solution. A careful standardization of 
lu me protocol, however, is a prerequisite for consistent staining quality. 

A variety of monoclonal antibodies directed against cell cycle-related 
nuclear antigens are commercially available and may be used for 
immunohistochemical staining of tissues and cells. The number of publications 
resulting from studies on human tumors using these antibodies is exponentially 
15 increasing. 

The antibody most conmionly employed is Ki-67, which stains a 
proliferation-related nuclear antigen in human cells of all lineages [Gerdes J, 
Schwab U, Lemke H, Stein H. Production of a mouse monoclonal antibody 
reactive with a human nuclear antigen associated with ceil proliferation. Int J 

20 Cancer 1983;31:13-20; Gerdes J, Lemke H, Baisch H, Wacker H-H, Schwab U, 
Stein H. Cell cycle analysis of a cell proliferation-associated human nuclear 
antigen defined by the monoclonal anKi-67. J Immunol 1984;133:1710-1715; 
and Gerdes J, Li L, Schlueter C, et al. Immunobiochemical and molecular 
biologic characterization of the cell proliferation-associated nuclear antigen that 

25 is defined by monoclonal antibody Ki-67. JPa/Zzo/ 1991;138:867-873]. This 
antibody has the useful property of staining nuclei of cells in Gj, S, G2, and M 
phases of the cell cycle, but not the nuclei of resting (Gq phase) cells. Several 
studies have demonstrated that the proportion of tumor cell nuclei stained by Ki- 
67 antibody correlates with tumor grade and other prognostic features for a 

30 variety of tumor types, including breast carcinoma, lymphoma, meningioma, glial 
and astrocytic brain tumors, malignant melanoma, and sarcoma. In non- 
Hodgkin's lymphoma, Ki-67 staining is associated with working classification 



M]()\vn the prognostic significance oi~ Ki-67 staining in this type of cancer. The 
clinical usefulness of Ki-67 antibody had been somewhat Hmited by the fact that 
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However, a monoclonal antibody (MIB 1 ) has been produced which appears to 
stain the same antigen as stained by Ki-67, yet which can be used on paraffin 
sections. Thus, it should be possible to perform large retrospective studies on 
archival paraffin-embedded tissues to determine the prognostic significance of 
5 staining with this antibody. The recently described antibody Ki-Sl appears to 
have similar staining characteristics as Ki-67 and can be used on paraffin 
sections. The relative fraction of tumor cell nuclei positive for Ki-Sl staining 
appears to have prognostic significance in breast cancer. 

Other proliferation-associated nuclear markers may prove to have clinical 

io utility. FCNAy'cyciin is a 36 kDa nuclear protein present in proliferating cells, 
and is an accessory protein to DNA polymerase-delta. Flow cytometric studies 
have demonstrated that two fractions of PCNA/cyclin exist in cell nuclei, the 
fraction that is insoluble in nonionic detergent being more restricted to the S 
phase of the cell cycle. Immunohistochemical staining for this protein has been 

15 demonstrated in frozen and paraffin-embedded tissues fixed in alcohol or 
formalin, thus permitting study of archival tissues. However, the staining in 
tissue sections varies depending on the method of tissue preparation and fixation 
as well as the clone of antibody used, and the degree of antigen detection appears 
to be sensitive to the duration of fixation, with long fixation times resulting in 

20 antigen loss. It was shown that detection of PCNA in paraffin embedded tissue 
can be improved using a microwave technique; excellent correlation with flow 
cytometric S-phase fraction was thereby obtained. Nuclei stained for 
PCNA/cyclin exhibit varying degrees of positivity, and studies have indicated 
that the more intensely stained nuclei correspond to S-phase cells. These issues 

25 are of course important to the accurate quantitation of antigen expression, 
regardless of the method used. 

Antibodies to alpha DNA polymerase have been applied to tissue sections 
of normal and malignant tissue, and may find clinical utility. PI 05 is a nuclear 
antigen expressed starting at the Gq/G\ phase transition, with increasing 

30 expression through M phase. However, attempts to use this antibody in tissue 
sections have met with variable success, and the antibody may prove to be a more 
useful tool in flow cytometric studies than in tissue section. There are changes in 



in most inimunohistochcinicai .studies using antibodies to proliferation- 
associated nuclear antigens, staining is measured by estimation or by tedious 
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makes routine clinical use unlikely, given the time constraints of a busy 
pathology practice. ' 

Quantitation of staining for nuclear antigens by image analysis provides 
the means of attaining the speed, accuracy, and reproducibility of such 

5 measurements. The CAS 200 System mentioned hereinabove makes use of two 
video cameras to view the microscopic image separately through optical filters 
that capture either all of the ethyl green stained nuclei within the field (650 nm), 
or the brown reaction product of the immunoperoxidase reaction (500 nm) in the 
same field. By superimposing maps of the green and brown staining regions, a 

10 rapid calculation is made of the percent nuclear area occupied by the 
immunohistochemical reaction. The threshold for positive staining is established 
using a slide stained with control antibody. It should be noted that this 
measurement is not identical to "percent positive nuclei", which would require 
that individual nuclei be counted and correlated with the staining reaction. Such 

15 measurements are more easily made on cytological preparations than on tissue 
sections, where distinguishing individual nuclei, which are frequently touching or 
overlapping, may be difficult or impossible. Nuclear area measurements are 
performed rapidly, and the result is expressed as the cumulative average of all the 
m.icroscopic fields measured. The intensity* of the staining reaction is not taken 

20 into account in this measurement, although the threshold for positive staining can 
be adjusted, for example, to measure only the most intensely stained nuclei rather 
than all positive nuclei. This system is however highly limited in spectral 
resolution and therefore has limited applications. It will be appreciated that 
employing a system enabling similar spatial resolution combined with higher 

25 spectral resolution would revolutionize the field of QIHC. 

While performing QIHC the selection of fields is important, because 
tumors can be quite heterogeneous with regard to proliferative activity, and it is 
uncertain whether the average or greatest proliferative activity is most clinically 
important. In studying malignant lymphomas, for example, Ki-67 staining was 

30 measured using either random field selection (computer generated) or selective 
measurement of fields judged as having the greatest proliferative fraction. The 
measurement by random field selection proved to correlate well with the grade of 



::;cLiS'jrcinent ol average prui;lcrati\ c acti\ ]l\ o\cr a large number ol fields i> 
most likely to be informative, in solid tumors haviim variable amounts of stroma. 
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In a study on the measurement of Ki-67 expression in breast cancer, a relatively 
weak correlation with flow cytometric S-phase fraction was found, which could 
be expected given the variable dilution of tumor cells unaccounted for by flow 
cytometry. 

If a statistically reliable measurement of average Ki-67 staining is to be 
obtained, it is necessary to measure sufflcient fields such that the variation of the 
cumulative percent staining does not vary more than 5 % of the mean. Some 
researchers argue that all such measurements should be expressed as the 
percentage values +/- the margin of error, which can be calculated on the basis of 
the sample size. The number of fields wiil vary depending on the heterogeneity 
within the tumor, but experience as well as statistical analysis has shown that 
approximately ten to twenty fields should be sufficient to attain a 95 % 
confidence interval in most cases. However, this average measurement may not 
be necessarily the most biologically relevant. 

It was shown using image analysis for measurement of PCNA/cycIin 
staining in breast cancer that there are significant differences in the degree of 
tumor cell proliferation in the central and peripheral portions of the tumor. 
Comparing the proliferation of the in situ and infiltrating components in 
individual cases of breast cancer, it was shovv-n that although these components 
usually exhibit similar degrees of Ki-67 staining, occasional discordances are 
seen which would affect the classification of the tumor as having a low or high 
proliferative fraction. Assuming that the infiltrating component is the more 
biologically relevant with regard to clinical course, it appears that careful 
attention to histopathology is an important consideration in choosing fields for 
measurement. In addition, changes in the level and pattern of nuclear expression 
during progression through the cell cycle have been noted for Ki-67 and 
PCNA/cyclin. Using image analysis, measurement of raining within a limited 
range of intensity as well as texture analysis may result in measurements more 
closely related to specific phases of the cell cycle, such as S phase. However, in 
any case, image analysis while providing excellent spatial resolution is very 
limited in spectral resolution, which limitation is addressed by the present 
invention. 



- .',!ol:ci. ii!crap>. i lie dcicrinuuition ol uuiiur estrogen receptor, most commonlx 
by biochemical techniques, has become standard in the diagnosis and treatment of 
breast cancer. In pcncral. "s -n ,,f p,,,;^,,,.;. „..-,(, , ,.. . . , 
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positive tumors show a response to hormonal therapy, whereas only 5 % of 
receptor-negative cases respond. 

In the United States, biochemical assays for estrogen receptor and 
progesterone receptor are predominantly used in breast cancer, particularly the 
dextran-coated charcoal (DCC) method. However, a number of technical 
problems with the biochemical assay limit its usefulness. First, the widespread 
use of mammography has resulted in an increasing proportion of resected tumors 
too small for biochemical analysis, which requires 300 to 500 mg of tissue, and 
fine-needle aspiration samples similarly cannot be evaluated by conventional 
methods. !n Brigham and Women's Hospital, approximately half of the resected 
breast tumors are too small for DCC analysis. Second, the lack of morphologic 
correlation can cause considerable error in the biochemical assay, as intermixed 
benign breast structures may lead to false-positive results, and excessive tumor 
dilution by normal and inflammatory cells can lead to false-negative results. 
Sampling error can be difficult to detect unless frozen sections are performed on 
the tissue prior to processing, a step not usually performed in most laboratories. 
Third, the DCC method is very labor-intensive. Therefore, there has been great 
interest in developing assay methods that circumvent these problems and improve 
the prognostic and therapeutic usefiilness of tumor hormone receptor 
determination. 

The commercial availability of monoclonal antibodies to estrogen receptor 
(ER) and progesterone receptor (PR) has made possible the visual detection of 
hormone receptors using standard immunohistochemical methods [Greene GL, 
Jensen EV, Monoclonal antibodies as probes for estrogen redetection and 
characterization. J Steroid Biochem 1982; 16:353-359]. Many studies have 
reported a good correlation between immunohistochemical determination of 
ER/PR and the standard biochemical method. Most of these studies have 
employed semiquantitative methods for analysing the immunohistochemical 
staining in tissue sections, methods that take into account the heterogeneity 
expression commonly seen in tumors. For example, the HSCORE used by 
McCarty and co-workers [McCarty KS, Szabo E, Flowers JL, et al. Use of a 
monoclonal anti-estrogen receptor antibody in the immunohistochemical 
evaluation nf h^iman tumor'; r'^^.v.-,-,- p,-- ioqa i^.vc..,,.,! i^n i 



liit, .-1.^.1 ..; liicinuu. Ulc >cn>iii\u\ ;in(j .Npcciiiciix v\ \nc aiitibod\ method 
compared to the biochemical assay were 88 % and 94 %, respectively (85). Other 
=;tudies have shown similar results. 
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Most studies report optimal sensitivity using cryostat sections of frozen 
tissue, but cytocentrifuge preparations, needle aspirates, and paraffin sections 
have all been tested with good results. Some studies have indicated that the 
immunohistochemical assay for ER is more predictive clinical response to 
hormonal therapy than the biochemical assay [Pertschuk LP, Kim DS, Nayer K, 
et al. Immunohistochemical estrogen and progesterone receptor assays in breast 
cancer with monoclonal antibodies: Histopathologic, demographic, and 
biochemical correlations and relationship to endocrine response and survival. 
Cancer 1990:66:1663-1670]. This is the strongest argumem in favour of the 
nev.'er method. More recently, some of the large cancer study groups in the 
United States have permitted the use of immunohistochemical determination of 
ER in their clinical trials, which will lead to more widespread acceptance of this 
method. 

A serious technical limitation in the use of immunohistochemical ER 
termination has been the difficulty of objectively analyzing and quanlitating the 
staining reaction. Semiquantitative methods, such as the HSCORE do not 
provide the reproducibility required among laboratories, and standards for 
measuring and reporting the staining reaction have not yet been established. The 
use of image analysis does offer an opportunity to provide such a standard of 
practice for quantitation of hormone receptors in breast cancer, and the nuclear 
staining pattern is easily adapted for QIHC, as described above for Ki-67 antigen, 
however, since it is highly limited in spectral resolution it is not applicable for a 
multiple markers/counter stains study. 

The main features of interest to be measured are the percent tumor cell 

nuclei stained for ER/PR, as well as the intensity of the staining. Both percent 

positivity (using total nuclear area) and intensity have been incorporated into a 

quantitative immunohistochemistry (QIHC) score, and an excellent correlation 

between QIHC score and biochemical detemiination of ER has been reported. 

However, intensity of staining is difficult to standardize and is subject to daily 

variation in the laboratory. A simpler approach, which was used, is to measure 

only the percent nuclear area stained, which appears to show linear correlation 

with biochemical ER measurements less than 200 fmole/mg protein. Using a cut- 
off of 10 "n nn<;iti\-o ttm^I^tv -ir-.^-i ,.■ ^ -I.-' ,. , n-> " ■ , ;.; , . . 
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heterogeneity. Cytometry 1991:12:207-220] describe an iinaeina method lb 
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and variations in nuclear area caused by tissue sectioning are taken into account. 
They believe this method provides superior predictive value for response to 
endocrine therapy in breast cancer. Again, based on imaging per se, this method 
is limited in spectral resolution, and is therefore not applicable in the detection of 
multiple immunohistochemical marker stains/histological stains/DNA ploidy 
stains. 

It is yet uncertain whether hormone receptors measured by QIHC need to 
be converted to biochemical values, as treatment decisions are based on whether 
the tumor is positive or negative, not on absolute value. Indeed, the tumor 
heterogeneity as repoited by QIHC may be of greater clinical relevance than 
biochemical levels, because the presence of a significant tumor fraction negative 
for hormone receptor may be predictive of failure to respond to therapy. Also, 
experience has shown that the majority of cases exhibit either no tumor cells 
positive for ER, or greater than 50 % of the cells positive, with few cases 
occurring near the cut-off of 10 % positivity. Therefore, the continuum of values 
seen in the biochemical assay may more reflect the variable dilution of tumor 
cells by benign tissue components than the true biologic range of receptor 
expression. Studies are needed to compare the clinical response to therapy with 
different image analytic features in order to provide a standard method for 
reporting QIHC of hormone receptors. 

Tumor sampling is another important issue that needs to be addressed in 
breast cancer. Not infrequently, the frozen portion of the tumor is not completely 
representative of the entire tumor. For example, the frozen tissue may contain 
only intraductal tumor, whereas a focus of invasive cancer is discovered on 
permanent sections. It is assumed that the biologic features of the invasive tumor 
are the most clinically relevant, and it cannot be assumed that the in situ and 
invasive tumor components exhibit identical features. A study was perfomied 
using image analysis to compare the invasive and non-invasive components of 
individual breast cancer cases with regard to hormone receptor expression. Good 
agreement between these components with regard to both absolute expression of 
ER (positive, negative) and level of expression of ER (percent nuclear area) was 
found. Discrepancies were observed, however, with regard to PR expression, and 



icponc'U p\ oUicr^. ihcrciorc, the iietcrogcneit} oi' expression ior each marker 
must be established in order to provide guidehncs for chnical measurement. 
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Theoretically, any immunohistochemical reaction that localizes in the cell 
nucleus, cell cytoplasm, or tissue can be quantitated using image analysis. 
However, analysis of a plurality of markers simultaneously calls for much higher 
spectral resolution than is inherently available in imaging systems. 

Cell surface and cytoplasmic antigens, particularly the products of 
oncogenes, are of great clinical interest. For example, Slamon and co-workers 
[Slamon DJ, Godolphin W, Jones LA, et al. Studies of the HER-2/neu proto- 
oncogene in human breast and ovarian cancer. Science 1989;235:177-182] have 
shown that both amplification and overexpression of HER-2/neu oncogene in 
breast and ovarian cancer correlate with a worsened prognosis. In their study, the 
intensity of immunostaining correlated well with other measures of gene 
expression, and the level of expression in ovarian cancer correlated with survival. 
These authors express the idea that measurement of oncogene products using 
immunohistochemical methods may have distinct advantages over biochemical 
methods, and may correlate best with clinical outcome. 

Various studies have demonstrated the feasibility of QIHC of oncogene 
expression. Czemiak et al. [(Czemiak B, Herz F, Wersto RP, et al. Quantitation 
of oncogene products by computer-assisted image analysis and flow cytometry. J 
Histochem Cytochem 1990;38:463=466] have demonstrated the use uf image 
analysis to measure cellular expression of several oncogene products expressed in 
the nucleus, cytoplasm, or cell membrane, and found that the results were similar 
to those obtained using flow cytometry. Czemiak et al. later used imaging to 
measure Ha-ras expression in bladder cancer [Czemiak B, Cohen GL, Etkind P, 
et al. Concurrent mutations of coding and regulatory sequences of the Ha-ras 
gene in urinary bladder carcinomas. J Histochem Cytochem 1992;23;1 199-1204], 
and were able to correlate increased p21 expression with specific gene mutations. 
Nuclear oncoproteins may be measured using image analysis in a manner similar 
to that described for hormone receptors and Ki-67 antigen, and expressed either 
as percent positive nuclear area or as a value that combines staining intensity with 
positivity. This approach was used by Figge et al. [Figge J, Bakst G, Weisheit K, 
Solis O, Ross JS. Image analysis quantitation of immuno-reactive retinoblastoma 
protein in human thyroid neoplasms with a streptavidin-biotin-peroxidase 
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Fkcausc of the problems of controlling daily variations in staining 
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Bacus et al. [Bacus SS, Ruby SG, Weinberg DS, Chin D, Oriz R, Bacus JW. 
HER-2/neu one expression and proliferation in breast cancers. Am J Pathol 
1990;137:103-1 1 1] used a combination of Feulgen stain (to measure DN content) 
and immunohistochemical staining for HER-2/neu in order to normalize the 
5 oncoprotein measurement to DNA content. Tumor cell lines with known levels 
of expression of the oncogene were used for calibration, to allow for daily 
variation in staining intensity. The average concentration oncoprotein could thus 
be computed on a per cell basis and was expressed as a percent of the level 
measured in a cell line known to exhibit high levels of overexpression. A 

10 ihreshulu for overexpression of HER-2/neu was established on the basis of the 
low level of expression present in normal tissue. Using this approach, the authors 
were able to correlate oncogene expression with proliferative fraction growth 
factor expression and DNA content ("ploidy") in breast cancer Bacus SS, Chin D, 
Stem RK, Ortiz R, Ruby SG, Weinberg DS. HER-2/neu one expression, DNA 

\5 ploidy and proliferation index in breast cancers. Anal Quant Histol 1 992; 14:433- 
445. 

Another example of a cellular protein that may have therapeutic 
importance is the product of the multiple drug resistance (mdr) gene, P- 
glycoprotein, a cell surface-associated ATPase that appears to be responsible for 

20 one mechanism of non-specific chemotherapy resistance. Grogan et al. [Grogan 
T, Dalton W, Rybski J, et al. Optimization of immunohistochemical P- 
glycoprotein assessment in multidrug-resistant plasma cell myeloma using three 
antibodies. Lab Invest 1991; 63:815-824] have shown a correlation between 
expression of P-glycoprotein and relapse in multiple myeloma, and have 

25 demonstrated the use of image analysis for measuring this protein as detected by 
IHC. They found that QIHC was more sensitive than Western blot for detecting 
P-glycoprotein expression. Other markers of therapy resistance, such as 
glutathione transferase and topoisomerase II, might be similarly studied. 

The measurement of tumor markers having prognostic and therapeutic 

30 significance is becoming an important part of diagnostic surgical pathology and 
cytology. Given the small size of many of the tumor samples (biopsies and 
needle aspirates), it will be necessary to use in situ methods, such as IHC, to 



;nL">c nieasurcmcnis. 

Like immunohistochemical stains, histological stains are routinely used m 
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Histopathology, which forms the foundation of our knowledge about 
diseases, is a non-quantitative morphological evaluation using stained 
histological samples in which the formation of chromatin-stain complexes 
enhances the shape and structure of cells and subcellular components. The 
nuclear structure may, in isolation, be viewed as a dynamic reflection of the 
metabolic state of the nucleus and as a physical correlate of its total content of 
biochemical constituents. The major nuclear components are DNA, RNA, 
histone and non-histone proteins, inorganic materials and water. These do 
change during malignant transformation along with cytoplasmic and functional 
de-differentiation and increase in the nucleo-cytoplasmic ratio. Studies have 
proven that alterations in nuclear structure, chromatin pattern and nucleolar size 
and number are morphologic hallmarks of cancer diagnosis. It was shown that 
computerized nuclear morphometry (CNM) of individual human breast cancer 
cells obtained by fine needle aspiration biopsy displayed higher reproducibility of 
classification than subjective observations with conventional histological 
preparations. Quantitative estimation of various parameters such as two 
dimensional estimates of average chromatin area in the nucleus, and the number 
of central chromatin regions have been shown to correlate with prognosis and 
differentiation in breast cancer. Mean nucleolar profile area and the largest 
nucleolar microscopic dimension were found to be of prognostic value in ocular 
melanomas. In astrocytic gliomas, the relationship between optical density and 
nuclear profile area was shown to correlate with patient survival. 

Histopathological classification uses different staining protocols in order 
to emphasize cellular structures of tissues and cells. The most common staining 
procedure used is hematoxylin and eosin (H&E); other procedures are the PAS 
stain for the demarcation of hydrocarbon moieties, Masson's trichrome stain for 
extracellular staining of collagen and the Romanowsky-Giemsa stain in 
hematopathology. 

In the classical H&E stain, hematoxylin staining of the nuclei is followed 
by counter-staining of the cytoplasm and various extracellular materials by eosin; 
in this process of nuclear staining, hematoxylin is oxidized to the purple dye 
hematein and is provided with a net positive charge by this metallic salt. The 



coniparal]\cly easy to niastcr and, most important, enables accurate microscopic 
diagnosis of most of the specimens. 
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In order to answer specific questions, additional techniques are used such 
as the PAS and Masson's trichrome stains. In PAS staining, substances 
containing vicinal glycol groups or their amino or alkylamino derivatives are 
oxidized by periodic acid to form dialdehydes, which combine with Schiff s 
reagent to form an insoluble magenta compound. Masson's trichrome staining 
uses phosphotungstic or phosphomolybdic acid in combination with several 
anionic dyes such as basic fiichsin, light green and hematoxylin. 

Romanowsky-Giemsa staining is used routinely in hematological practice 
to demonstrate the various hemopoietic cells, both in the normal and in the 
diseased state. In the process of Romanowsky-Giemsa staining, acidic eosin 
binds to hemoglobin (in red cells) and eosinophylic granules (in granulocytes), 
while basic azure binds to chromatin and ribosome-rich cytoplasm. Following 
this phase, eosin and azure B combine to form a complex yielding the purple 
element known as the Romanowsky-Giemsa effect. Structures exhibiting this 
-effect- show a charactefistic absorption band at" applbximatel^ 550 nm, the so- 
called Romanowsky band. The Romanowsky-Giemsa technique is also used for 
the demonstration of various lymphoreticular elements (including mast cells) and 
micro-organisms in paraffin- embedded material. 

In the evaluation of infiltrating brea.st carcinomas, ductal and lobular 
carcinomas may present similar histological appearances [Azzopardi JG, Chepick 
OF, Hartmann WH, Jafarey NA, Lombart-Bosch A, Ozello L (1982). The World 
Health Organization histological typing of breast tumors. 2nd ed. Am J Clin 
Pathol 78:806-816]. Some quantitative histopathological variables have been 
identified by morphological methods as an aid to the differentiation between 
ductal and lobular carcinomas [Ladekarl M and Sorensen FB (1993). Quantitative 
histopathological variables in in situ and invasive ductal carcinoma of the breast. 
AMPIS 101(12):895-903]. The attempts to grade and to differentiate, or in other 
words to classify the tumors have been based mainly on nuclear morphology and 
chromatin structure [Ladekarl M and Sorensen FB (1993). Quantitative 
histopathological variables in in situ and invasive ductal carcinoma of the breast. 
AMPIS 101(12):895-903; Comelisse CJ, de Konig HR, Moolenaar AJ (1984). 
Image and flow cytometric analysis of DNA content in breast cancer; relation to 
estrogen receptor content and Ivmph node inx'^^lvf^'-ppnt An-ii r\ 



( 1991). Nuclear grading of breast carcinoma by image analysis. Classification by 
multivariate and neural network anal\s!s Am i ri-ii p-i'U,..] o--^^<) ■ 
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Morphometric classification of other tumor types, such as but not limited to 
leukemias, lymphomas, sarcomas and other carcinomas [see, for example, Clarke 
AM, Reid WA and Jack AS (1993) Combined proliferating cell nuclear'antigen 
and morphometric analysis in the diagnosis of cancerous lymphoid infiltrates. J. 
Clin. Pathol. 46:129-134] are also vastly implemented both in research medical 
practice. 

Nevertheless, as was recently published following an NIH workshop 
which evaluated the reliability of histopathological diagnosis by the best 
pathologists in the field of cancer diagnostics, there is a discordance among 
expert pathologists in the diagnosis of neoplasm. Based on this workshop, it was 
concluded that histopathological decisionmaking is 1 00 % subjective, regardless 
of the origin of specimen and that this state of affairs in histopathological 
diagnosis is not confined to a specific tumor, but is applicable to differemial 
diagnosis in every organ. These conclusions were published in an editorial by A 
Bernard Ackennan ( 1996) entitled "Discordanc'e among expert pathologists in 
diagnosis of melanocytic neoplasm", in Human pathology 27:1 1 1 5-1 1 16. 

Close to 80 % of breast carcinomas are of the ductal type [Aaltomaa S, 
Lipponen P: Prognostic factors in breast cancer (reviews). Int J Oncol 1:153, 
1992; Toikkanen S, Jensuu H (1990). Prognostic factors and long-tenn survival 
in breast cancer in a defined urban population. APMIS 98:1005-1014]. The 
differentiation between ductal and lobular carcinomas has proven to be useftil for 
evaluation of patient prognosis and determination of treatment [Ellis 10, Galea 
M, Broughton N, Locker A, Blaney RW and Elston CW (1992). Pathological 
prognostic factors in breast cancer: II Histological type; relationship with survival 
in a large study with long term follow-up. Histopathology 20:479-489; Eskelinen 
M, Lipponen P, Papinaho S, Aaltomaa S, Kosma VM, Klemi P (1992). DNA 
flow cytometry, nuclear morphometry, mitotic indices and steroid receptors as 
independent prognostic factors in female breast cancer. Int J Cancer 51:555-561; 
and Toikkanen S, Jensuu H (1990). Prognostic factors and long-term survival in 
breast cancer in a defined urban population. APMIS 98:1005-1014]. The tumors 
have some differences in clinical behavior and in the pattern of metastasis; 
lobular carcinoma is more multifocal and bilateral than ductal carcinoma 
[Azzopardi .TG. Chepick Of Hrirrmnn" T'>f'iv,.. \- ^ t , , 
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Prognosis in infiltrating lobular carcinoma: an analysis of -'classical^' and variant 
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Nicholson RI, Robertson JFR (1991). An evaluation of differences in prognosis, 
recurrence patterns and receptor status between invasive lobular and other 
invasive carcinomas of the breast. Eur J Surg Oncol 17:251-257]. The two tumor 
types are morphologically different, cells of infiltrating lobular carcinoma are 
usually smaller than those of ductal carcinoma, less pleomorphic and have fewer 
mitotic figures. Infiltrating ductal carcinoma cells have more prominent nucleoli 
[Azzopardi JG, Chepick OF, Hartmann WH, Jafarey NA, Lombart-Bosch A, 
Ozello L (1982). The World Health Organization histological typing of breast 
tumors. 2nd ed. Am J Clin Pathol 78:806-816]. 

Some histological types of intraductal carcinoma have been recognized: 
comedo, cribriform, micropapillaiy and solid. All are recognized and classified 
by specific criteria and subdivided primarily by architectural pattern, cellular 
pleomorphism, and nuclear hyperchromasia [Page DL, Anderson TG (1987). 
Diagnostic histopathology of the breast. Edinburgh, Scotland: Churchill 
Livingstone, 120-157; Lagios MD (1990). Duct cScinoma />3 pathology and 
treatment. Surg Clin North Am 70:853-871; and Lennington WJ, Jensen RA, 
Dalton LW, Page DL: Ductal carcinoma in situ of the breast: Heterogeneity of 
individual lesions. Cancer 73:118-124, 1994]. The survival expectancy for 
lobular carcinomas is usually better than that of ductal carcinomas [DiConstanzo 
D, Rosen PP, Gareen I, Franklin S, Lesser M (1990). Prognosis in infiltrating 
lobular carcinoma: an analysis of "classical" and variant tumors. Am J Surg 
Pathol 14:12-23; du Toit RS, Locker AP, Ellis 10, Elston CW, Nicholson RI, 
Robertson JFR (1991). An evaluation of differences in prognosis, recurrence 
patterns and receptor status between invasive lobular and other invasive 
carcinomas of the breast. Eur J Surg Oncol 17:251-257]. Lobular carcinomas are 
more often bilateral and multifocal [Ladekarl M, Sorensen FB: Prognostic, 
quantitative histopathologic variables in lobular carcinoma of the breast. Cancer 
72:2602, 1993] and the pattern of metastasis from the tumors was found to be 
different. Unfortunately, histological classification of breast carcinomas is 
subjected to low reproducibility and attempts to classify morphological subtypes 
of lobular carcinomas with different prognoses, therefore seem futile [Ladekarl 
M, Sorensen FB: Prognostic, quantitative histopathologic variables in lobular 
carcinoma of the breast Cancer "'''■if^in? ioq-!! nnti. ImKmIt i i.. . • . 
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been shown to correlate with differentiation and prognosis. Alterations in nuclear 
structure are the morphologic hallmark of cancer diagnosis. Nuclear size, shape, 
chromatin pattern have all been reported to change in breast cancer [Pienta KJ, 
Coffey DS; Correlation of nuclear morphometry with progression of breast 
cancer. Nuclear Morphometry of breast cancer 2012, 1991]. However, 
heterogeneity in morphology and biology of tumors belonging to the same 
classification group has been found to be the most prominent feature of breast 
cancer [Komitowski DD and Janson CP (1990). Quantitative features of 
chromatin structure in the prognosis of breast cancer. Cancer 65:2725-2730]. 

Ajv.ong 1 1 c>tclogical parameters that were examined by de-ias-Morenas 
et al, [de-las-Morenas A, Crespo P, Moroz K and Donnely MM (1995). 
Cytological diagnosis of ductal versus lobular carcinoma of the breast. Acta Cytol 
39(5):865-869] using an automated morphometric system on cytological 
specimens, chromatic pattern, nuclear size and overall cell size were found lo be 
statistically different between infiltrating lobular and infiltrating ductal c^^^^ 
cell nuclei. Thus, the presence of coarsely granular chromatin, nuclear size of 
more than 44 and cell size of more than 82 ^m2, were found to be related to 
ductal carcinoma. 

Ladekarl and Sorensen found that the main thrpp-Htmensional nuclear ^i7e 
the main nuclear profile area and the mitotic index were all significantly larger in 
ductal than in lobular carcinomas, whereas the main nuclear density index was 
smaller in ductal carcinoma [Ladekarl M, Sorensen FB: Prognostic, quantitative 
histopathologic variables in lobular carcinoma of the breast. Cancer 72:2602, 
1993]. Yu et al also identified some distinct nuclear features useful in the 
differentiation of infiltrating ductal and lobular carcinoma [Yu GH, Sneige 
Kidd LD, Johnston and Katz RL (1995). Image analysis derived morphometric 
differences in fine needle aspirated of ductal and lobular breast carcinoma. Anal 
Quant Cytol Histol 17(2):88-92]. 

Beside in solid tumors, the use of histological stains and 
immunohistochemical markers is also applicable for diagnosis, prognosis and 
treatment of various hematological malignancies, an example thereof is chronic 
lymphocytic leukemia (CLL). The over-accumulation of small, mature- 
appearing, R-Ivmnhoc\1e'^ in the rrriphernl MonH fnrv^^M^^-r^ni ;..,n.>vri ^ 



lymphocytes and the dominant cellular population of CLL both consist ol" small 
cells with dense, clumped nuclear chromatin, which makc^ 'hv ii^^'-cM^-" 
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between these lymphocytic populations difficult by conventional light 
microscopy. Some cases differ in morphological feature from the typical mature, 
small cell B-CLL: (i) a mixture of small lymphocytes and prolymphocytes (>10 
% and <55 %) designated as CLL/PL, or (ii) CLL mixed with large lymphocytes. 

The French- American-British group (FAB) has proposed criteria based on 
cytochemical and immunological methods in order to establish a clear diagnosis. 
Immunophenotypic analysis reveals large amounts of surface immunoglobulin 
(slg) in normal B cells which is only weakly expressed, or undetectable, on B- 
CLL cells. The CLL cell expresses the pan-B antigens CD 19 and CD20 and the 
activation antigens CD5 and CD23, however it docs not express tlie terminal B- 
cell differentiation antigens exhibited by plasma cells. B-CLL cells express 
either kappa or lambda-light chains and the monoclonality is essential to establish 
the diagnosis. Receptors for mouse red blood cell rosettes (MRBC-R) are 
detectable on both B-CLL cells and normal B cells, however, the two populations 
- express^ different patterns of complement TeceptdrT whic^^^^^ m^^ 
distinguish therebetween. 

U.S. Pat. No. 5,086,476, to Bacus et al., which is incorporated by 
reference as if fully set forth herein, teaches an image processing method and 
apparatus for determining a proliferation index of a cell samole bv stai nina the 
cells with a chromogen for a proliferation substance and a counterstain for the 
cell nuclei. The chromogen is activated by an antibody-enzyme conjugate which 
binds to the proliferation substance to produce a stained cell sample. The stained 
cell sample is examined with an optical microscope, forming a portion of the 
apparatus, which produces a magnified cell sample image. The apparatus 
optically filters the cell sample image and produces a pair of optically enhanced 
proliferation substance and cell nuclei images. The enhanced images are 
electronically analyzed to detemiine the amounts of cell nuclei and proliferation 
substance appearing in the images, respectively. The amounts are then compared 
to yield a proliferation index for the portion of the cell sample appearing in the 
cell sample image. 

U.S. Pat. No. 5,109,429 to Bacus et al., which is incorporated by reference 
as if fully set forth herein, teaches a kit for the quantitation of components in cell 
nuclei, wherein the kit includes a stain and microscopic slides Fnrii q'ur- h^. 



as if fully set forth herein, teaches an image analysis system for the quantitation 
of nuclear proteins in cell populations. Particularly, the hormonal receptor 



wo 00/31534 



PCT/US99/27000 



28 

content of fine needle aspirates of human breast carcinomas are evaluated. 
Estrogen or progesterone receptors are amplified and visualized in the specimen 
by a staining technique of the immunoperoxidase type. Monoclonal antibodies 
specific against the receptor are attached to the receptor sites and are then 
amplified by a bridging antibody which attaches to the monoclonal antibody and 
a peroxidase-antiperoxidase complex. A chromogen, diaminobenzidine is 
combined with the complex and treated with hydrogen peroxide to react with the 
peroxidase forming an insoluble brown precipitate which marks the receptor sites 
for optical identification. The specimen is then counterstained with another 
chromogen, methyl green which is specific to the nucleus of each ceil. Two 
monochromatic filterings optically separate the areas stained by the receptor site 
optical enhancer and the nuclear area optica] enhancer. Measurements of the 
optical density values of the stained receptor areas yield an intensity value 
directly related to the quantity of hormonal receptor in the specimen. A 
comparison of- the. nuclear area containing hormonal receptor with the total 
nuclear area yields a percentage value which indicates the distribution of cells 
throughout of the specimen which contain receptor. These two values for 
intensity and distribution are then combined to yield a predictive score for an 
assay. The measured score when compared to an empirically derived reference 
score is predictive of the prognosis of endocrine therapy. 

U.S. Pat. No. 5,281,517 to Bacus et al., which is incorporated by reference 
as if fully set forth herein, teaches a method and apparatus for selecting and 
analyzing a subpopulation of cells or cell objects for a certain parameter such as 
DNA using image analysis means. The cells are first stained with an alkaline 
phosphatase technique including a monoclonal antibody specific to a protein in at 
least one of the cell's cytoplasm or on a ceil membrane, thereby marking any cells 
including the protein as to type. A second staining of the DNA in the nucleus is 
accomplished by a Feulgen technique that destroys the cell cytoplasm. After the 
staining and marking, the cells may then be gated using the image analysis means 
on the visual parameter such as colored DNA or colored antigen into a 
subpopulation that is to be measured. The selected cells may then be examined by 
digital image processing and measured for a parameter such as a true actual 
measurement of DNA in picograms. A quantitation of the measured mmmptrr 
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on the slide and for producing an interactive video signal corresponding to the 
viewed image. An automated optical subsystem includes a single high power 
microscope objective for scanning a rack of slides, portions of which having been 
previously identified for assay in the interactive optical means. The system also 
5 includes a processor for processing the interactive and automatic video signals 
for the two optical subsystems. The processor receives the automatic video signal 
and performs biological assay functions upon it. A method and apparatus are also 
disclosed for marking points for later analysis on the microscope slides and for 
associating an analysis function with each marked point. 

!0 U.S. Pat. No. 5,252,487 to Bacus et al., which is incorporated by reference 

as if fully set forth herein, teaches an apparatus and method for determining an 
amount of oncogene protein product copies in a cell includes an optical 
conversion module for measuring an amount of optically enhanced DNA in a cell 
sample. A subsystem for measuring an amount of an optically enhanced 

15 - oncogene TJTOTeiii -product protein p^^^^^ to the DNA measuring 

means. A subsystem for comparing the measured DNA amount and measured 
oncogene protein product amount produces an oncogene protein product copy 
measurement which is fed to an output device for producing an output indicative 

of the amnunts of the 

- ~- — — ^lotwiii piuuuwi 111 iin., cs,iia uL ulc ecu sample. 

2° U Pat. No. 5,288,477 to Bacus et al., which is incorporated by reference 

as if fully set forth herein, teaches a method for prognosticating the effectiveness 
of a chemotherapy using monoclonal antibodies and ligand molecules. The 
putative anti-cancer agent has binding specificity for a oncogenic receptor 
molecule on the membrane of a cancer cell, such as HER-2/neu. When the 

25 putative agent binds to the oncogenic receptor, the receptor translocates from the 
membrane to the cytoplasm or perinucleus of the cancer cell, accompanied by a 
transient increase in the total cellular content of the receptor, and results in 
terminal cell differentiation. The efficacy of the agent in vivo can be determined 
in vitro by treatment of biopsied cancer cells with the agent and subsequent 

30 examination of the cells for evidence of terminal cell differentiation. Such 
evidence includes morphological change, reduction in cell growth, or production 
of chemicals associated with the mature phenotj'pe. Additionally, treated cells 



.;.ca.-,urir;g apucM Uerisiiic;, alter siaiiimg can pc used lo ciL'tcnniiic tI•a^^locatl 
as well as a transient increase in total cellular content of the receptor. 
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U.S. Pat. No. 5,134,662 to Bacus et al, which is incorporated by reference 
as if fill ly set forth herein, teaches a method and apparatus for use in performing 
automated classification of cells and other microscopic specimens. The apparatus 
provides a compact, adjustable assembly that is operable to provide: an operator- 
apparatus interactive classification system for the cell analysis; alternative 
techniques for different cells, cytoplasms and cell populations; and enhanced 
image or color separation and analysis. 

U.S. Pat. No. 5,473,706 to Bacus et al., which is incorporated by reference 
as if fully set forth herein, teaches an apparatus and method for automated assay 
of biological specimens positioned on microscope slides. The apparatus 
comprises an interactive optical subsystem for viewing the biological specimen 
on the slide and for producing an interactive video signal corresponding to the 
viewed image. An automated optical subsystem includes a single high power 
microscope objective for scanning a rack of slides, portions of which having been 
previousFy identified for assay rn the interact 

also includes a processor for processing the interactive and automatic video 
signals from the two optical subsystems. The processor receives the automatic 
video signal and performs biological assay functions upon it. 

U.S. Pat. No. 5,526,258 to Bacus et al., which is incorporated by reference 
as if fully set forth herein, teaches an apparatus and method for analyzing the cell 
objects of a cell sample for the diagnosis and treatment of actual or suspected 
cancer is disclosed. An image of the cell sample is first digitized and 
morphological attributes, including area and DNA mass of the cell objects are 
automatically measured from the digitized image. The measured attributes are 
compared to ranges of attribute values which are preestablished to select 
particular cell objects having value in cancer analysis. After the selection of cell 
objects, the image is displayed to an operator and indicia of selection is displayed 
with each selected cell object. The operator then reviews the automatically 
selected cell objects, with the benefit of the measured cell object attribute values 
and accepts or changes the automatic selection of cell objects. In a preferred 
embodiment, each selected cell object is assigned to one of six classes and the 
indicia of selection consists of indicia of the class into which the associated cell 
object has been placed The ^rn^Mrorl PiV a -t^,;-,. ,,r ^ -i 
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as if fully set forth herein, teaches an apparatus and method for measuring the 
thickness of a tissue section with an autcMnatcd imaec annh/^'i^ s\'Ntr--^ r^.-..c.,aT^ 
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using polyploid nuclear DNA content, for subsequent use in analyzing cell 
objects of a specimen cell sample for the diagnosis and treatment of actual or 
suspected cancer or monitoring any variation in the nominal thickness in a 
microtome setting. An image of a measurement material, such as a rat liver tissue 
5 section, having known cell object attributes is first digitized and the 
morphological attributes, including area and DNA mass of the cell objects, are 
automatically measured from the digitized image. The measured attributes are 
compared to ranges of attribute values which are preestablished to select 
particular cell objects. After the selection of the cell objects, the operator may 

10 review the automatlcaiiy selected cell objects and accept or change the measured 
cell object attribute values. In a preferred embodiment, each selected cell object 
is assigned to one of three classes corresponding to diploid, tetraploid and 
octoploid cell morphology and the measured DNA mass of the identified cell 
object fragments in the rat liver tissue section sample may be corrected. Next, the 

15 selected cell objects of the measurement material, e.g., DNA Mass, are then 
graphically displayed in a histogram and the thickness of the rat liver tissue 
section can be measured based upon the distribution. 

U.S. Pat. No. 5,018,209 to Bacus et al., which is incorporated by reference 
as if fully set forth herein, teaches a method and apparatus for selecting and 

20 analyzing a subpopulation of cells or cell objects for a certain parameter such as 
DNA, estrogen, and then measuring the selected cells. The observer in real time 
views a field of cells and then gates for selection based on the morphological 
criteria those cells that have the visual parameter such as colored DNA or colored 
antigen into a subpopulation that is to be measured. The selected cells are 

25 examined by digital image processing and are measured for a parameter such as a 
true actual measurement of DNA in picograms. A quantitation of the measured 
parameter is generated and provided. 

U.S. Pat. No. 4,998,284 to Bacus et a!., which is incorporated by reference 
as if fully set forth herein, teaches a method and apparatus for use in performing 

30 automated classification of cells and other microscopic specimens. The apparatus 
provides a compact, adjustable assembly that is operable to provide: an operator- 
apparatus interactive classification system for the cell analysis; alternative 
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testing and evaluating various cells, antigens, or other materials taken from the 
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quantified by image analysis using pattern recognition techniques. The user is 
provided with a unique slide or support on which there are specimen and 
reference materials or objects which are simultaneously stained or otherwise 
image enhanced at the time of analysis. 
5 The following conclusions can be drawn from the above discussion. 

First, in situ analysis of neoplasm may be useful for clinical applications, 
to enable better diagnosis, prognosis and treatment strategy. 

Second, histological stains, unique immunohistochemical markers and 
DNA ploidy stains, both conventional and immunostains, are all useful for that 
10 Dumose. 

Third, so far it was not attempted or suggested to use a plurality of specific 
immunohistochemical stains combined with several histological stains and DNA 
ploidy stains to label cells and thereafter extract pathological data therefrom 
because, while systems providing the adequate spatial resolution (imaging 
15 systems) are widely used, systems providing the adequate spatial resolution 
combined with an adequate spectral resolution are much less abundant. 

Such systems, however, were developed and recently were employed for 
various applications as further detailed hereinunder. 

A spectrometer is an apparatus designed to accept light, to separate 
20 (disperse) it into its component wavelengths, and measure the lights spectrum, 
that is the intensity of the light as a function of its wavelength. An imaging 
spectrometer is a spectrometer which collects incident light from a scene and 
measures the spectra of each pixel (i.e., picture element) thereof. 

Spectroscopy is a well known analytical tool which has been used for 
25 decades in science and industry to characterize materials and processes based on 
the spectral signatures of chemical constituents therein. The physical basis of 
spectroscopy is the interaction of light with matter. Traditionally, spectroscopy is 
the measurement of the light intensity emitted, scattered or reflected from or 
transmitted through a sample, as a function of wavelength, at high spectral 
30 resolution, but without any spatial information. 

Spectral imaging, on the other hand, is a combination of high resolution 
spectroscopy and high resolution imaging (i.e., spatial information). Most of the 
works so far described concern either '^^t-vn^^^o -n^^; J 



-.-.ciai ..!-^-K'iL- i\iiKi-pa^^ nitci> [^cc. Anucrsson-hru^cis ci ai. i 1990) 
Proceedings of SPIIZ - Bioimaging and Two-Dimensional Spectroscopy, 1205, 
pp. 179-189]. or alternatively obtainine hieh spectra! re^e^itirM. r.. - , f,;i! 
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spectrum), yet limited in spatial resolution to a small number of points of the 
sample or averaged over the whole sample [See for example, U.S. Pat. No. 
4,930,516, to Alfano et al.]. 

Conceptually, a spectral imaging system consists of (i) a measurement 

5 system, and (ii) an analysis software. The measurement system includes all of the 
optics, electronics and the manner in which the sample is illuminated (e.g., light 
source selection), the mode of measurement (e.g., fluorescence or transmission), 
as well as the calibration best suited for extracting the desired results from the 
measurement. The analysis software includes all of the software and 

10 mathematical algorithms necessary to analyze and display important results in a 
meaningful way. 

Spectral imaging has been used for decades in the area of remote sensing 
to provide important insights in the study of Earth and other planets by 
identifying characteristic spectral absorption features originating therefrom. 

15 However, the high cost, size and configuration of remote sensing spectral 
imaging systems (e.g., Landsat, AVIRIS) has limited their use to air and satellite- 
born applications [See, Maymon and Neeck (1988) Proceedings of SPIE - 
Recent Advances in Sensors, Radiometry and Data Processing for Remote 
Sensing, 924, pp. 10-22; Dozier (1988) Proceedings of SPIE - P.ecent Advances 

20 in Sensors, Radiometry and Data Processing for Remote Sensing, 924, pp. 23- 
30]. 

There are three basic types of spectral dispersion methods that might be 
considered for a spectral bio-imaging system: (i) spectral grating or prism, (ii) 
spectral filters and (iii) interferometric spectroscopy. As will be described below, 
25 the latter is best suited to implement the method of the present invention, yet as 
will be appreciated by one ordinarily skilled in the art, grating, prism and filters 
based spectral bio-imaging systems may also be found useful in some 
applications. 

In a grating or prism (i.e., monochromator) based systems, also known as 
30 slit-type imaging spectrometers, such as for example the DILOR system: [see, 
Valisa et aL (Sep. 1995) presentation at the SPIE Conference European Medical 
Optics Week, BiOS Europe 1995, Barcelona, Spain], only one axis of a CCD 

.i..^o nas a ^iii m a lirsi local pianc, limitum llic licld oi \'ic\\ at anv uu cn time U> 
a line of pixels. Therefore, a full image can only be obtained after scanning the 

';^'\atin5^ for pri^tr^^ or the iiu'^o^ri^nr ^^oa^ii in a direction rnraMel m ^ncct^'al a\'- 
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of the CCD in a method known in the literature as line scanning. The inability to 
visualize the two-dimensional image before the whole measurement is completed, 
makes it impossible to choose, prior to making the measurement, a desired region 
of interest from within the field of view and/or to optimize the system focus, 

5 exposure time, etc. Grating and prism based spectral imagers are in use for 
remote sensing applications, because an airplane (or satellite) flying over the 
surface of the Earth provides the system with a natural line scanning mechanism. 

It should be further noted that slit-type imaging spectrometers have a 
major disadvantage since most of the pixels of one frame are not measured at any 

10 given time, even thougli tlie fure-optics of the instrument acmaiiy collects 
incident light from all of them simultaneously. The result is that either a 
relatively large measurement time is required to obtain the necessary information 
with a given signal-to-noise ratio, or the signal-to-noise ratio (sensitivity) is 
substantially reduced for a given measurement time. Furthermore, slit-type 

15 spectral imagers require line scanning to collect the necessary information for the 
whole scene, which may introduce inaccuracies to the results thus obtained. 

Filter based spectral dispersion methods can be further categorized into 
discrete filters and tunable filters. In these types of imaging spectrometers the 
f^nectral image is built by fi.ltering the radiation for all the pixels of the scene 

20 simultaneously at a different wavelength at a time by inserting in succession 
narrow band filters in the optical path, or by electronically scanning the bands 
using acousto-optic tunable filters (AOTF) or liquid-crystal tunable filter (LCTF), 
see below. Similarly to the slit type imaging spectrometers equipped with a 
grating or prism as described above, while using filter based spectral dispersion 

25 methods, most of the radiation is rejected at any given time. In fact, the 
measurement of the whole image at a specific wavelength is possible because all 
the photons outside the instantaneous wavelength being measured are rejected 
and do not reach the CCD. 

Tunable filters, such as AOTFs and LCTFs have no moving parts and can 

30 be tuned to any particular wavelength in the spectral range of the device in which 
they are implemented. One advantage of using tunable filters as a dispersion 
method for spectral imaging is their random wavelength access; i.e., the ability to 

lUiicr radiation tnal talis oiitSKic ol this spectral range must be biockeu, iw) 
temperature sensitivity, (lii) poor transmission, (iv) polarization sensitivity, and 
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(v) in the case of AOTFs an effect of shifting the image during wavelength 
scanning, demanding careful and complicated registration procedures thereafter. 

All these types of filter and tunable filter based systems have not been 
used successfiilly and extensively over the years in spectral imaging for any 
application, because of their limitations in spectral resolution, low sensitivity, and 
lack of easy-to-use and sophisticated software algorithms for interpretation and 
display of the data. 

A method and apparatus for spectral analysis of images which have 
advantages in the above respects was disclosed in U.S. Pat. application No. 
08/392,019 10 Cabib et al, filed Feb. 2lst, 199^, now U.S. Pat. No. 5,539,517, 
issued Jul. 23, 1996, which is incorporated by reference as if fully set forth 
herein, with the objective to provide a method and apparatus for spectral analysis 
of images which better utilizes all the information available from the collected 
incident light of the image to substantially decrease the required frame time 
and/or to substantially increase the signal-to-noise ratio, as compared to the 
conventional slit- or filter type imaging spectrometer, and does not involve line 
scanning. According to this invention, there is provided a method of analyzing 
an optical image of a scene to determine the spectral intensity of each pixel 
thereof by collecting incident light ft'om the scene; passing the light through an 
interferometer which outputs modulated light corresponding to a predetermined 
set of linear combinations of the spectral intensity of the light emitted from each 
pixel; focusing the light outputted from the interferometer on a detector array, 
scanning the optical path difference (OPD) generated in the interferometer for all 
pixels independently and simultaneously and processing the outputs of the 
detector array (the interferograms of all pixels separately) to determine the 
spectral intensity of each pixel thereof. This method may be practiced by 
utilizing various types of interferometers wherein the OPD is varied to build the 
interferograms by moving the entire interferometer, an element within the 
interferometer, or the angle of incidence of the incoming radiation. In all of these 
cases, when the scanner completes one scan of the interferometer, the 
interferograms for all pixels of the scene are completed. 

Apparatuses in accordance with the above features differ from the 



inlcrlcrcnce tunable tillers, thercb> substantially uicrcasmg the total 
throughput of the system. Thus, interferometer based apparatuses better utilize 
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thereby substantially decreasing the measurement time and/or substantially 
increasing the signal-to-noise ratio (i.e., sensitivity). The sensitivity advantage 
that interferometric spectroscopy has over the filter and grating or prism methods 
is known in the art as the multiplex or Fellgett advantage [see. Chamberlain 
(1979) The principles of interferometric spectroscopy, John Wiley and Sons, pp. 
16-18 and p. 263]. 

Consider, for example, the "whisk broom" design described in John B. 
Wellman (1987) Imaging Spectrometers for Terrestrial and Planetary Remote 
Sensing, SPIE Proceedings, Vol. 750, p. 140. Let n be the number of detectors in 
the linear array, mx m\hc number of pixels in a frame and Tthe frame time. The 
total time spent on each pixel in one frame summed over all the detectors of the 
array is nTIm , By using the same size array and the same frame rate in a method 
according to the invention described in U.S. Pat. No. 5,539,517, the total time 
spent summed over all the detectors on a particular pixel is the same, nThr?'. 
However, whereas in the conventional grating or prism method the energy seen 
by every detector at any time is of the order of \ln of the total, because the 
wavelength resolution is \ln of the range, in a method according to the invention 
described in U.S. Pat. application No. 08/392,019 the energy is of the order of 
unit>% because the modulating function is an oscillating function (e.g., sinusoidal 
(Michelson) or similar periodic function such as low finesse Airy function with 
Fabry-Perot) whose average over a large OPD range is 50%. Based on the 
standard treatment of the Fellgett advantage (or multiplex advantage) described 
in interferometry textbooks [for example, see. Chamberlain (1979) The principles 
of interferometric spectroscopy, John Wiley and Sons, pp. 16-18 and p. 263], it is 
possible to show that devices according to this invention have measurement 
signal-to-noise ratios which are improved by a factor of 

«0-5 in the cases of noise 

limitations in which the noise level is independent of signal (system or 
background noise limited situations) and by the square root of the ratio of the 
signal at a particular wavelength to the average signal in the spectral range, at 
wavelengths of a narrow peak in the cases the limitation is due to signal photon 
noise. Thus, according to the invention described in U.S. Pat. No. 5,539,517, all 
the required OPDs are scanned simultaneously for all the pixels of the scene in 

, 3 . ,^^ .u,, ;,.r ..; . , . i . . , .... . .\ . . ,• . 

^ ■ : . . I I I ^ ■ I ■ ^ I - . ■. .... . ... ■ , . i . ; . I 1 i ^ .. . I . :. ] . 

Lonlieurations, .^uch as a telescope lor remote sensing, a microscope tor 
laboratory' analysis, fundus cameras for retinal imagmg, fiber optics and 
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endoscopes for industrial monitoring and medical imaging, diagnosis, therapy 
and others. / 

In a continuation application (U.S. Pat. application 08/571,047 to Cabib et 
aL, filed December 12, 1995, now U.S. Pat. No. 5,748,162, which is incorporated 

5 by reference as if fully set forth herein) the objective was to provide spectral 
imaging methods for biological research, medical diagnostics and therapy, which 
methods can be used to detect spatial organization (i.e., distribution) and to 
quantify cellular and tissue natural constituents, structures, organelles and 
administered components such as tagging probes (e.g., fluorescent probes) and 

10 drugs using light transmission, reflection, scattering and fluorescence emission 
strategies, with high spatial and spectral resolutions. In U.S. Pat. application 
08/571,047, the use of the spectral imaging apparatus described in U.S. Pat. No. 
5,539,517 for interphase fluorescent in situ hybridization of as much as six loci 
specific probes (each loci located on a different chromosome) was demonstrated, 

15 as well as additional biological and medical applications. 

Spectral bio-imaging systems are potentially useful in all applications in 
which subtle spectral differences exist between chemical constituents whose 
spatial distribution and organization within an image are of interest. The 
measurem.ent can be carried out using virtually any optical system attached to the 

20 system described in U.S. Pat. No. 5,539,517, for example, an upright or inverted 
microscope, a fluorescence microscope, a macro lens, an endoscope and a fundus 
camera. Furthermore, any standard experimental method can be used, including 
light transmission (bright field and dark field), auto-fluorescence and 
fluorescence of administered probes, etc. 

25 Fluorescence measurements can be made with any standard filter cube 

(consisting of a barrier filter, excitation filter and a dichroic mirror), or any 
customized filter cube for special applications, provided that the emission spectra 
fall within the spectral range of the system sensitivity. Spectral bio-imaging can 
also be used in conjunction with any standard spatial filtering method such as 

30 dark field and phase contrast, and even with polarized light microscopy. The 
effects on spectral information when using such methods must, of course, be 
understood to correctly interpret the measured spectral images. 

.c.^^.. LicicctuHi. gradingj neoplasm, uhicn arc designed lo pr()\ idL' obiecti\'c, a.^ 
opposed to subjective cell (e.g., cancer cell) classification. According to the 

method disr!^\sed 'herein :\ '^r^mple indnrhnr' ^im^t :\ i^^^w;,,,.. ,r v. -, ^ .-.-^ 
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cell is prepared to be spectrally imaged; (b) the sample is viewed through an 
optical device optically connected to an imaging spectrometer for obtaining a 
spectrum of each pixel of the sample; (c) each of the pixels is classified into 
classification groups according to the pixels spectra; and (d) by analyzing the 
classification groups of pixels, the cells of the sample are classified into cell 
classes. This method was exemplified with respect to counterstained breast 
carcinomas. 

The combination of spectral imaging, in situ counterstaining and in situ 
immunostaining is suggested and attempted herein for the first time. Such a 
combination enables simultaneous detection of a plurality of 
immunohistochemical stains, histological stains and DNA ploidy stains which 
was not possible using the prior art imaging methods. Such a combination is 
therefore expected to revolutionize the field of cellular pathology by combining 
data extracted simultaneously from various histological stains, DNA ploidy stains 
15 and specific immunohistochemical stains. 

There is thus a widely recognized need for, and it would be highly 
advantageous to have, a method of simultaneous in situ analysis of a plurality of 
immunohistochemical stains, histological stains and DNA ploidy stains, using 
spectra! imaging techniques of high spatial and spectral resolutions. 

20 

SUMMARY OF THE INVENTION 

According to the present invention there is provided a method of in situ 
analysis of a biological sample comprising the steps of (a) staining the biological 
sample with N stains of which a first stain is selected from the group consisting 

25 of a first immunohistochemical stain, a first histological stain and a first DNA 
ploidy stain, and a second stain is selected from the group consisting of a second 
immunohistochemical stain, a second histological stain and a second DNA ploidy 
stain, with provisions that N is an integer greater than three and further that (i) if 
the first stain is the first immunohistochemical stain then the second stain is either 

30 the second histological stain or the second DNA ploidy stain; (ii) if the first stain 
is the first histological stain then the second stain is either the second 
immunohistochemical stain or the second DNA ploidy stain; whereas (iii) if the 



.ample, the spectral data collccuon device and the N stains arc selected such thai 
a spectral component associated with each of the N stains is collectable. 



wo 00/31534 



PCT/US99/27000 



39 



According to further features in preferred embodiments of the invention 
described below, there is provided a method of in situ analysis of a biological 
sample comprising the steps of (a) staining the biological sample with a plurality 
of stains of which a first stain is selected from the group consisting of a first 
immunohistochemical stain, a first histological stain and a first DNA ploidy stain, 
and a second stain is selected from the group consisting of a second 
immunohistochemical stain, a second histological stain and a second DNA ploidy 
stain, with a provision that (i) if the first stain is the first immunohistochemical 
stain then the second stain is either the second histological stain or the second 
DNA pioidy stain; (ii) if the first stain is the first histological stain then the 
second stain is either the second immunohistochemical stain or the second DNA 
ploidy stain; whereas (iii) if the first stain is the first DNA ploidy stain then the 
second stain is either the second immunohistochemical stain or the second 
histological stain; and (b) using a spectral data collection device for collecting 
spectral data fi-om the biological sample, the spectral data collection device and 
the plurality of stains are selected such that a spectral component associated with 
each of the plurality of stains is collectable. 

According to still further features in the described preferred embodiments 



the steps of (a) staining the biological sample with at least four different 
immunohistochemical stains; and (b) using a spectral data collection device for 
collecting spectral data from the biological sample, the spectral data collection 
device and the at least four immunohistochemical stains are selected such that a 
spectral component associated with each of the at least four 
immunohistochemical stains is collectable. 

According to still further features in the described preferred embodiments 
there is provided a method of in situ analysis of a biological sample comprising 
the steps of (a) staining the biological sample with at least three stains of which at 
least one stain is an immunohistochemical stain and at least one additional stain is 
a histological stain or a DNA ploidy stain; and (b) using a spectral data collection 
device for collecting spectral data from the biological sample, the spectral data 
collection device and the at least three stains are selected such that a spectral 



;iic biL'ps u! (a) staining ihc niological sample \Mtti at least three stain^ oi which a 
first stain is an immunohistochemical stain, a seeond stain is a histoloeical stain 



in situ analysis of a biological sample comprising 




1 1 
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device for collecting spectral data from the biological sample, the spectral data 
collection device and the at least three stains are selected such that a spectral 
component specifically associated with each of the at least three stains is 
collectable. 

5 According to still further features in the described preferred embodiments 

there is provided an immunohistochemical composition comprising at least four 
different immunohistochemical stains, each being for staining a respective 
cytological marker and each being individually detectable in a presence of all 
others using a spectral data collection device. 

iO According to stiil further features in the described preferred embodiments 

the first and second immunohistochemical stains each independently includes a 
primary antibody and a signal amplification mechanism. 

According to still further features in the described preferred embodiments 
the signal amplification mechanism is selected from the group consisting of a 

15 secondary antibody capable of binding a constant region of the primary antibody, 
avidin or strepavidin capable of binding biotin conjugated to the primary antibody 
and biotin capable of binding avidin or strepavidin conjugated to the primary 
antibody. 

According to stil! further features in the described preferred embodiments 
20 the secondary antibody, avidin, strepavidin and biotin are each independently 
labeled with a detectable moiety. 

According to still further features in the described preferred embodiments 
the detectable moiety is a fluorescent dye. 

According to still further features in the described preferred embodiments 
25 the fluorescent dye is selected from the group consisting of Fluorescein, 
Rliodamine, Texas Red, Cy2, Cy3, Cy5, CyO, CyO.5, Cyl, Cyl.5, Cy3.5, Cy7, 
VECTOR Red, ELF™ (Enzyme-Labeled Fluorescence), FluorX, Calcein, 
Calcein-AM, CRYPTOFLUOR™'S, Orange (42 kDa), Tangerine (35 kDa), Gold 
(31 kDa), Red (42 kDa), Crimson (40 kDa), BHMP, BHDMAP, Br-Oregon, 
30 Lucifer Yellow, Alexa dye family, N-[6-(7-nitrobenz-2-oxa-l, 3-diazol-4- 
yl)amino]caproyl] (NBD), BODIPY''"'^, boron dipyrromethene ditluoride, Oregon 
Green, MITOTRACKER™ Red, DiOC7(3), DilCig, Phycoery^hrin, 

TIT,. ■ y^pr \n in,'' ppr .-'^lo in/' rr>r in/ ^ nr- - ^ r - 



V \ciiL <v.Tl)P-lv!b()SC (cCil)PKj, LalcoliiK): W hite, l\Tt)sinc and i nptoplian. 

According to still farther features in the described preferred embodiments 
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According to still further features in the described preferred embodiments 
the non-fluorescent dye is selected from the group consisting of alkaline 
phosphatase, horseradish peroxidase, glucose oxidase and beta-galactosidase 
substrates. 

According to still further features in the described preferred embodiments 
the detectable moiety is an enzyme catalyzing a colorimetric reaction of a 
substrate having a substantially non-soluble color reaction product. 

According to still further features in the described preferred embodiments 
the enzyme is selected from the group consisting of alkaline phosphatase, 
iiorserauish peroxidase, p-galactObiuase, and giucose oxidase. 

According to still further features in the described preferred embodiments 
the substrate is selected from the group consisting of alkaline phosphatase, 
horseradish peroxidase, p-galactosidase, and glucose oxidase substrates. 

According to still further features in the described preferred embodiments 
the detectable moiety is an enzyme catalyzing a luminescence reaction of a 
substrate having a substantially non-soluble reaction product capable of 
luminescencing or of directing a second reaction of a second substrate having a 
luminescencing product. 

According to still further features in the described preferred embodiments 
the enzyme is selected from the group consisting of luciferase and aequorin. 

According to still further features in the described preferred embodiments 
the first and second substrates are each independently selected from the group 
consisting of luciferine, ATP, Ca"^"^ and coelenterazine. 

According to still further features in the described preferred embodiments 
the first and second histological stains are each independently selected from the 
group consisting of 4',6-diamidino-2-phenylindole, Eosin, Fluorescein 
isothiocyanate, Hoechst 33258, Hoechst 33342, Propidium Iodide, Quinacrine, 
Fluorescein-phalloidin, Resorufin, hematoxylin, Orange G, Light Green SF, 
Romanowsky-Giemsa, May-Grunwald, Blue counterstain, ethyl green, Feulgen- 
naphthol yellow S, Giemsa, Methylene Blue, Methyl Green, pyronin, Naphthol- 
yellow, Neutral Red, Papanicolaou stain, Red Counterstain C and Sirius Red, 

According to still further features in the described preferred embodiments 
^hc ^r^t nnri t^crnnd DNA nlni*H\- st^inv o^-i. \^A.-,r^.^rrh-T^f}- <i ^ i r. 



-ii::nii> liuoropncnx'^. urcci; i- luorcscciii I'rotcm lu.scd to DSA bincimu 

protein, ACMA, Quinacrine and Acridine Orange, Feulgen reagent, Gallocvanin 
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chrom-alum, Gallocyanin chrom-alum and naphthol yellow S, Methyl green- 
pyronin Y and Thionin-Feulgen reagent. , 

According to still further features in the described preferred embodiments 
the spectral data collection device is selected from the group consisting of an 
interferometer-based spectral data collection device, filters-based spectral data 
collection device and a dispersion element-based spectral data collection device. 

According to still flirther features in the described preferred embodiments 
each of the first and second immunohistochemical stains independently includes a 
primary antibody. 

According to sti!! farther features in the described pieferrcd embodiments 
the primary antibody is selected from the group consisting of anti-estrogen 
receptor antibody, anti-progesterone receptor antibody, anti-p53 antibody, anti- 
Her-2/neu antibody, anti-EGFR antibody, anti-cathepsin D antibody, anti-Bcl-2 
antibody, anti-E-cadherin antibody, anti-CA125 antibody, anti-CA15-3 antibody, 
anti-CA19-9 antibody, anti-c-erbB-2 antibody, anti-P-glycoprotein antibody, anti- 
CEA antibody, anti-retinoblastoma protein antibody, anti-ras oncoprotein 
antibody, anti-Lewis X antibody, anti-Ki-67 antibody, anti-PCNA antibody, anti- 
CD3 antibody, anti-CD4 antibody, anti-CD5 antibody, anti-CD7 antibody, anti- 
CD8 antibody, anti-CD9/p24 antibodv. anti-CDin antihr^dv anti-CDllc 
antibody, anti-CD 13 antibody, anti-CD 14 antibody, anti-CD 15 antibody, anti- 
CD 1 9 antibody, anti-CD20 antibody, anti-CD22 antibody, anti-CD23 antibody, 
anti-CD30 antibody, anti-CD31 antibody, anti-CD33 antibody, anti-CD34 
antibody, anti-CD35 antibody, anti-CD38 antibody, anti-CD41 antibody, anti- 
LCA/CD45 antibody, anti-CD45RO antibody, anti-CD45RA antibody, anti-CD39 
antibody, anti-CDlOO antibody, anti-CD95/Fas antibody, anti-CD99 antibody. 
anti-CD 1 06 antibody, anti-ubiquitin antibody, anti-CD71 antibody, anti-c-myc 
antibody, anti-cytokeratins antibody, anti-vimentins antibody, anti-HPV proteins 
antibody, anti-kappa light chains antibody, anti-lambda light chains antibody, 
anti-melanosomes antibody, anti-prostate specific antigen antibody, anti-S-100 
antibody, anti-tau antigen antibody, anti-fibrin antibody, anti-keratins antibody 
and anti-Tn-antigen antibody. 

Further according to the present invention there is provided a method of 
resolving individual stain imac^cs from n ^^iolorrirn^ c;nmni^ ctnft.^vT wi^ .t i - , - 



^^^^4'^^' ^'ii^nuiUjia a c.:i^iiKitcu ^pl:^l^^iI^ lor ca^n o\ liic pixci> and lor each 
of the at least two independent stains, the calculated spectrum being equivalent to 
an actual spectrum that would have been measured u^ino the ^rcc^^al (b.V] 
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collection device had the biological sample been individually stained with one of 
the at least two individual stains; (c) operating a displaying algorithm on each of 
the calculated spectra for displaying each of the pixels in a calculated artificial 
color being equivalent to an actual color that would have been perceived for each 
of the pixels using a microscope had the biological sample been individually 
stained with the one of the at least two individual stains. 

According to still further features in the described preferred embodiments 
the method further comprising the step of (d) recombining at least two of the 
individual stain images into a combined image being equivalent to an actual 
image that would have been perceived should the individual stain images 
respective stains would have been used for containing the biological sample and 
would have been viewed using a microscope. 

According to still ftirther features in the described preferred embodiments 
the calculated spectrum is effected by calculating an absorbance spectrum for 
each of the pixels for each of the at least two independent stains and then 
calculating a corresponding transmittance spectrum for each of the pixels for 
each of the at least two independent stains. 

According to still further features in the described preferred embodiments 
an overall transmittance of the biological sample stained with the at least two 
independent stains is expressed as a sum of the corresponding transmittance 
spectra of the at least two independent stains. 

According to still further features in the described preferred embodiments 
each individual stain spectrum of the at least two independent stains is 
constructed by correlating the sum of the corresponding transmittance spectra 
with reference spectra of the at least two independent stains. 

Further according to the present invention there is provided a method of 
resolving individual stain images from a biological sample stained with at least 
rwo individual stains, the method comprising the steps of (a) using a spectral data 
collection device for collecting spectral data from each pixel of the biological 
sample; (b) calculating a calculated spectrum for each of the pixels and for each 
of the at least two independent stains, the calculated spectrum being equivalent to 
an actual spectrum that would have been measured using the spectral data 
collection device had the biological sample been individnnlh' stnin^d wit^^ onr 



'^^ '''t^ vvjui vaiLiii aw ac tual ^uioi ui aj. cqui\cilciii (iddilioiiai -^tain a> 
would have been perceived for each of the pixels using a microscope had the 
biological sample been individually stained with the additional stain. 
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The present invention successfiiUy addresses the shortcomings of the 
presently known configurations by providing a method of simultaneous in situ 
analysis of a plurality of immunohistochemical stains, histological stains and 
DNA ploidy stains, using spectral imaging techniques of high spatial and spectral 
resolutions. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The invention herein described, by way of example only, with reference to 
the accompanying drawings, wherein: 

FIG. 1 is a block diagram illustrating the main componenis of an imaging 
spectrometer constructed in accordance with U.S. Pat application No. 08/392,019 
(prior art), 

FIG. 2 illustrates a non-moving type interferometer, namely, a Sagnac 
mterferometer, as used in an imaging spectrometer in accordance with U.S. Pat 
application No. 08/392,019 (prior art). 

FIGs. 3a-c show interphase FISH performed with two different probes 
attached to Texas-Red and Rhodamine wherein (a) is an original image, the way 
it looks thorough a microscope; (b) is the same sample, after being measured and 
processed by the SPECTRACUBE™ system; and (c) are the fluorescence spectra 
of the Texas-Red and Rhodamine fluorophores. 

FIGs. 4a-c show interphase FISH performed using the SPECTRACUBE^^ 
system with six different probes each labeled with a different fluorophore 
wherein (a) is an original image, the way it looks thorough a microscope, cells 
were counter stained with DAPI; (b) is the same sample, after being measured 
and processed by the SPECTRACUBE™ system; and (c) are the fluorescence 
spectra of the six fluorophores which were employed for classification. 

FIGs. 5a-c present hybridization results of 24 chromosomal paints with a 
normal male chromosome spread using the SPECTRACUBE^^ system, wherein 
Figure 5a is an RGB image obtained using an RGB algorithm. Figures 5b and 5c 
are classification images obtained using a classification algorithm, whereas 
Figures 5a and 5b present the original spread and Figure 5c presents the 
chromosome spread arranged as a karyotype. 

FIG. 6 shows a definition of pseudo-RGB (Red Green inH i^i. .>^ . ' . 



MG. 7 presents non-nomialized spectra of two histological stains 
(hematoxylin and eosin) and of four immunohistochemical qains (]^^y^ Fi^* 
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Red, AEC and BCIP/NBT) measured using the SPECTRACUBE™ system from 
six single stain stained breast cancer samples. Peak wavelengths are indicated on 
the right. 

FIGs. 8a-e show images of a breast cancer sample which was previously 
determined to be ER(+)/PR(+) co-stained with the histological stain hematoxylin 
and with the immunohistochemical stain anti-ER-DAB, wherein Figure 8a 
presents an RGB image of the sample, Figures 8b-d present binarized images of 
hematoxylin, DAB and AEC spectral components, respectively, whereas Figure 
Be presents a classification overlay image, wherein the above spectral 
components are highlighted in red, green and blue, respectively, all as measured 
using the SPECTRACUBE™ system. 

FIGs. 9a-e show images of a breast cancer sample which was previously 
determined to be ER(+)/PR(+) co-stained with the histological stain hematoxylin 
and with the immunohistochemical stain anti-PR-AEC, wherein Figure 9a 
presents an RGB image of the sample, Figures 9b-d present binarized images of 
hematoxylin, DAB and AEC spectral components, respectively, whereas Figure 
9e presents a classification overlay image, wherein the above spectral 
components are highlighted in red, green and blue, respectively, all as measured 
using the SPECTRACUBE^^ system. 

FIGs. lOa-e show images of a breast cancer sample which was previously 
determined to be ER(+)/PR(+) co-stained with the histological stain hematoxylin 
and with the immunohistochemical stain anti-PR-Fast Red, wherein Figure 10a 
presents an RGB image of the sample. Figures lOb-d present binarized images of 
hematoxylin, DAB and Fast Red spectral components, respectively, whereas 
Figure lOe presents a classification overlay image, wherein the above spectral 
components are highlighted in red, green and blue, respectively, all as measured 
using the SPECTRACUBE™ system. 

FIGs. 1 la-e show images of a breast cancer sample which was previously 
determined to be ER(+)/PR(+) co-stained with the histological stain hematoxylin 
and with the immunohistochemical stains anti-ER-DAB and anti-PR-Fast Red, 
wherein Figure 11a presents an RGB image of the sample. Figures 1 Ib-d present 
binarized images of hematoxylin, DAB and Fast Red spectral components, 
respectively, whereas Figure 1 le presents a classifj 



FIGs. 12a-f show images of a breast cancer sample which was previously 
detemiined to be ERf^Y^PRf-) co-staincd with the histological stairi'^ hc}^■:\u■^y^■]u^ 
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and eosin and with the immunohistochemical stains anti-ER-DAB and anti-PR- 
Fast Red, wherein Figure 12a presents an RGB image of the sample, Figures 12b- 
e present binarized images of hematoxylin, eosin, DAB and Fast Red spectral 
components, respectively, whereas Figure 12f presents a classification overlay 
image, wherein the above spectral components are highlighted in blue, purple 
green and red, respectively, all as measured using the SPECTRACUBE™ system. 

FIG. 13 presents non-normalized spectra of five histological stains (Harris 
hematoxylin, eosin, orange G, light green SF and Bismark brown Y) measured 
using the SPECTRACUBE^^ system from five single stain stained cervix cancer 
samples. Peak wavelengths arc indicated on the right. 

FIGs. 14a-g show images of a cervix cancer sample co-stained with the 
histological stains Harris hematoxylin, eosin, orange G, light green SF and 
Bismark brown Y, which collectively form what is known in the art as 
Papanicolaou stain, wherein Figure 14a presents an RGB image of the sample. 
Figures 14b-f present binarized images of Harris hematoxylin, eosin, orange G, 
light green SF and Bismark brown Y spectral components, respectively, whereas 
Figure 14e presents a classification overlay image, wherein the above spectral 
components are highlighted in blue, pink, orange, green and gray, respectively, to 
form by combinations thereof the colorfu! classification overlay image, all as 
measured using the SPECTRACUBE™ system. 

FIG. 15 shows normalized transmission spectra measured without slide, 
with slide, with a slide + cover slip and through an unstained tissue. The 
differences are minor. 

FIG. 16 shows absorption spectra of five histological stains as measured 
with the SPECTRACUBE system combined with a Nikon microscope. 

FIG. 17 shows an RGB image of a prostate tissue section co-stained with 
hematoxylin and eosin which is identical to the image that is seen while viewing 
the same sample using conventional transmittance microscopy. 

FIGs. 18 and 19 show the resolved images of hematoxylin and eosin 
obtained using the algorithm according to the present invention, respectively. 

FIGs. 20 and 21 show the resolved images of hematoxylin and eosin 



n> reintegrating the spectral data used to obtain the images presented m Fieure 
20 and 21. 
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FIG. 23 shows an RGB image of a uterus tissue section co-stained with 
BCIP-NBT, Vector SG and Nuclear Fast Red, which is identical to- the image that 
is seen while viewing the same sample using conventional transmittance 
microscopy. 

5 FIGs. 24, 25 and 26 show the resolved images of BCIP-NBT, Vecor SG 

and Nuclear Fast Red obtained using the algorithm according to the present 
invention, respectively. 

FIGs. 27, 28 and 29 show the resolved images of BCIP-NBT, Vecor SG 
and Nuclear Fast Red obtained according to the present invention shown as if 
10 each had been employed solely, respectively, 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is of a method of simultaneous in situ analysis of a 
plurality of immunohistochemical stains, histological stains and/or DNA ploidy 
15 stains which can be used in pathological examination of cells. Specifically, the 
present invention can be used to provide a pathologist with cumulative 
information regarding an examined biological sample and assist in decision 
making. 

The principles and operation of a method according to the present 
20 invention may be better understood with reference to the drawings and 
accompanying descriptions. 

Before explaining at least one embodiment of the invention in detail, it is 
to be understood that the invention is not limited in its application to the details of 
construction and the arrangement of the components set forth in the following 
25 description or illustrated in the drawings. The invention is capable of other 
embodiments or of being practiced or carried out in various ways. Also, it is to 
be understood that the phraseology and terminology employed herein is for the 
purpose of description and should not be regarded as limiting. 

Recent studies have shown that the optical mixtures of several absorbing 
30 stains can be analyzed in certain cases. Where the absorption bands of the 
individual stains do no overlap, the analysis is simple and straight forw^ard. 
Wavelengths are selected where each component in turn displays an absorption 



/Lcii su^ccs>UiH\ used 111 pathok)g\ Npcciincns b\- iiacus ei al. [ibid.j. Ihc 
adx antages of this technique are that (i) it provides insight into the biochemical 

composition of the cell or tissue: fii^ imar^r ncciui^it'oi^ 'c, .i^^^-i^, r,--'"— ^^-M ^- 
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using narrow band filters. Unfortunately, current cytochemistry and 
histochemistry offer a very limited number of such dyes with nonoverlapping 
spectra. 

Thus, in accordance with one aspects of the teachings of the present 
invention there is provided a method of in situ analysis of a biological sample. 
The method is effected by executing the following method steps, in which, in a 
first step, the biological sample is stained with N (i.e., a plurality of) stains of 
which a first stain is a first immunohistochemicai stain, a first histological stain 
or a first DNA ploidy stain, and a second stain is a second immunohistochemicai 
stain, a second histological .stain or a <!prnnH dma^ nioidv stsin 

Provisions are taken such that N is an integer greater than three (e.g., 4, 5, 
6, 7, 8, 9, 10 or more, e.g., an integer between 1 1 and 50, inclusive) and further 
that (i) if the first stain is the first immunohistochemicai stain then the second 
stain is either the second histological stain or the second DNA ploidy stain; (ii) if 
the first stain is the first histological stain then the second stain is either the 
second immunohistochemicai stain or the second DNA ploidy stain; whereas (iii) 
if the first stain is the first DNA ploidy stain then the second stain is either the 
second immunohistochemicai stain or the second histological stain. 

In a second step of the method according to the oresent i n vent! on ?? 
spectral data collection device is used for collecting spectral data from the 
biological sample, the spectral data collection device and the N stains are selected 
such that a spectral component associated with each of the N stains is collectable. 

In accordance with another aspects of the teachings of the present 
invention there is provided another method of in situ analysis of a biological 
sample. The method is effected by executing the following method steps, in 
which, in a first step, the biological sample is stained with at least four different 
immunohistochemicai stains. In a second step of the method a .spectral data 
collection device is used for collecting spectral data from the biological sample, 
the spectral data collection device and the at least four immunohistochemicai 
stains are selected such that a spectral component associated with each of the at 
least four immunohistochemicai stains is collectable. 

In accordance with yet another aspects of the teachings of the present 
invention there is provided yet another method of 



■ ^ -y^^^'^i iiwiniiMonishKiicjiiiLai >ia!u and ai least one 

additi(-)nal stain is a histok^gical stain or a DNA ploidy stain. In a second step of 
the method, a spectral data collection device is used for collcctinrr M^ectra! da^n 
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from the biological sample, the spectral data collection device and the at least 
three stains are selected such that a spectral component associated with each of 
the at least three stains is collectable. 

In accordance with still another aspects of the teachings of the present 
invention there is provided still another method of in situ analysis of a biological 
sample. The method is effected by executing the following method steps, in 
which, in a first step, the biological sample is stained with at least three stains of 
which a first stain is an immunohistochemical stain, a second stain is a 
histological stain and a third stain is a DNA ploidy stain. In a second step of the 
method, a spectral data collection device is used for collecting spectral data from 
the biological sample, the spectral data collection device and the at least three 
stains are selected such that a spectral component specifically associated with 
each of the at least three stains is collectable. 

In accordance with an additional aspects of the teachings of the present 
invention there is provided a immunohistochemical composition which includes 
in a mixture at least four different immunohistochemical stains, each being for 
staining a respective cytological marker in the biological sample and each being 
individually detectable in a presence of all others using a spectral data collection 
device. 

As used herein in the specification and in the claims section below, the 
term ''in situ'' or "m situ analysis" refers to an analysis of cellular or tissue 
components situated and preferably fixated in their natural place or position 
within the cell or tissue. 

As used herein in the specification and in the claims section below, the 
term "biological sample" refers to a sample retrieved from an animal, mammals 
and human beings in particular. The sample may be of a healthy tissue, disease 
tissue or tissue suspected of being disease tissue. The sample may be a biopsy 
taken, for example, during a surgical procedure. The sample may be collected via 
means of fine needle aspiration, scraping or washing a cavity to collects cells or 
tissue therefrom. The sample may be of a tumor both solid and hematopoietic 
tumors, as well as of neighboring healthy tissue. The sample may be a smear of 
individual cells or a tissue section. 

As used herein in the ^pr'riflrnt''^n ^nri i^-r. ,.1.,;,^^^ u ,i ,, .i 



As used herein in the specification and in the claims section below, the 
term "stain" or "stains" refers to colorants, either f!noresrri:t. |mt-.;t.--.. .-^^! nr^.-r,..- 
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non-fluorescent and ftirther to reagents or matter used for effecting coloration. 
The terms "chromogen(s)" or "dye(s)" are equivalent to the term *;Stain(s)", all of 
which are used interchangeably herein. 

As used herein in the specification and in the claims section below, the 
term "immunohistochemical stain" refers to colorants, reactions and associated 
reagents in which a primary antibody which binds a cytological marker is used to 
directly or indirectly (via "sandwich" reagents and/or an enzymatic reaction) stain 
the biological sample examined. Immunohistochemical stains are in many cases 
referred to in the scientific literature as immunostains, immunocytostains, 
immunohistopathological stains, etc. 

As used herein in the specification and in the claims section below, the 
term "antibody" refers to any monoclonal or polyclonal immunoglobulin, or a 
fragment of an immunoglobin such as sFv (single chain antigen binding protein), 
Fabl or Fab2. 

As used herein in the specification and in the claims section below, the 
term "histological stain" refers to any colorant, reaction and/or associated 
reagents used to stain cells and tissues in association with cell components such 
as types of proteins (acidic, basic), DNA, RNA, lipids, cytoplasm components, 
nuclear components, membrane components, etc. Histological stains are in many 
cases referred to as counterstains, cytological stains, histopathological stains, etc. 

As used herein in the specification and in the claims section below, the 
term "DNA ploidy stain" refers to stains which stoichiometrically bind to 
chromosome components, such as, but not limited to, DNA or histones. When an 
antibody is involved, such as anti-histone antibody, such stains are also known as 
DNA immunoploidy stains. 

As used herein in the specification and in the claims section below, the 
term "spectral data collection device" refers to any device capable of detecting 
light intensity associated with a plurality, t}^pically four or more, of distinct 
spectral bands in each spatial element (pixel) of the examined sample. For 
example, the SPECTRACUBE'^'^ system optically connected to a microscope 
preferably serves as the spectral data collection device according to the present 
invention. However, any spectral imager, i.e., an instrument that measures and 



( LC I 1- )) and dispersive element (e.g., grating or prism) based spectrai iniagers. or 
other spectral data or multi-band light collection devices (e.g., a device in 
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(1996) Karyotyping human chromosomes by combinatorial multi-fluor FISH, 
Nature Genetics, 12:368-375) can be used to acquire the required spectral data. 
Also a device which includes a plurality of wide band filters (fixed or tunable), as 
described in U.S. Pat. application No. 08/917,213, filed August 25, 1997, and is 
incorporated by reference as if fiilly set forth herein, can be used as the spectral 
data collection device according to the present invention. Therefore, it is 
intended not to limit the scope of the present invention for use of any specific 
type of spectral data collection device, nor to any specific type of spectral imager. 

Thus, the spectral data collection device can be an interferometer-based 
spectral data collection device, tllter(s)-based spectral data collection device and 
a dispersion element-based spectral data collection device. 

As used herein in the specification and in the claims section below, the 
tenn "spectral component" refers to a part of a spectrum which is unique to a 
specific substance and therefore may be used as a spectral signature of that 
substance, to differentiate that substance from other substances. 

According to one embodiment of the present invention the 
immunohistochemical stains each independently includes a primary antibody and 
a signal amplification mechanism. The signal amplification mechanism can 
employ, for example, a secondary antibody capable of binding a constant region 
of the primary antibody, avidin or strepavidin capable of binding biotin 
conjugated to the primary antibody, and biotin capable of binding avidin or 
strepavidin conjugated to the primary antibody. 

According to a preferred embodiment of the present invention, the 
secondary antibody, avidin, strepavidin or biotin are each independently labeled 
with a detectable moiety, which can be an enzyme directing a colorimetric 
reaction of a substrate having a substantially non-soluble color reaction product, a 
fluorescent dye (stain), a luminescent dye or a non-fluorescent dye. Examples 
concerning each of these options are listed hereinbelow. 

The enzyme employed can be, for example, alkaline phosphatase, 
horseradish peroxidase, p-galactosidase and/or glucose oxidase; and the substrate 
can respectively be an alkaline phosphatase, horseradish peroxidase, (i- 
galactosidase or glucose oxidase substrate. 

directing a second reaction ol a ^ece)nd substrate, such as bail not linntcd to, 
luciferine and ATP or coelenterazine and Ca^ ^ having a luminescencmg 
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Examples for optional histological and DNA ploidy stains which can be 
employed while implementing the methods of the present invention are given 
hereinunder. 

According to a most preferred embodiment of the present invention each 
of the immunohistochemical stains employed includes a primary antibody. 

According to yet another preferred embodiment of the present invention 
external calibration is employed to account for day-to-day variations experienced 
when staining is attempted. Thus, at least one calibration is preferably attempted 
for every staining batch. To this end. calibration material is employed, wherein 
the biological sample and the calibration material are stained at the same time 
with the same staining solutions. The spectral data collection device is first used 
to analyze the stained calibration material such that adjustment thereof or 
extraction of calibrating data for algorithmic post measurement calibration 
becomes feasible. Only then the biological sample can be more meaningfully 
analyzed, taking into account a calibration based correction. One ordinarily 
skilled in the art would know how to devise a calibrating algorithm to 
compensate for day-to-day variations experienced when staining is attempted. 

The calibration material can be an optical density reference material. 
Alternatively, the calibration m.aterial can include control cells which are 
simultaneously co-stained' together with the examined biological sample. 

The following lists various dyes or stains which can be used to implement 
the methods of the present invention. Further included is a list of natural cell 
constituents having a detectable spectral signature which can be co-detected with 
the stains using the methods of the present invention. 

It will be appreciated by one ordinarily skilled in the art that some staining 
procedures may interfere with others. Therefore the type of stains employed and 
their sequence of application should be well considered. These considerations 
can be applied by one ordinarily skilled in the art, knowing the staining 
procedures. 

Immunohistochemical stains for use in transmittance microscopy: In 
principle, any enzyme that (i) can be conjugated to or bind indirectly to (e.g., via 
conjugated avidin, strepavidin, biotin, secondary antibody) a primar>' antibody, 
and fii) use^ n soluble siih^trate tr> nrn\'lH-'^ nn lorr^inm- , 



,wr\c;;iiic piiu^piiaiahc [Ai*) .^uDNiratcs incrLuic. t)ui arc not liniiicd to, AP- 
Bluc substrate (blue precipitate, Zymed catalog p. 61); AP-Orange substrate 
(oranee. prccinitate, ZvmedV AP-Recl ^ub^^trate (red. red ^^('(^ipr-it-- "^^^ 
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bromo, 4-chloro, 3-indolyphosphate (BCIP substrate, turquoise precipitate), 5- 
bromo, 4-chloro, 3-indolyl phosphate/nitroblue tetrazolium/ iodonitrotetrazolium 
(BCIP/INT substrate, yellow-brown precipitate, Biomeda), 5-bromo, 4-chloro, 3- 
indolyphosphate/nitroblue tetrazolium (BCIP/NBT substrate, blue/purple), 5- 
bromo, 4-chloro, 3-indolyI phosphate/nitroblue tetrazolium/iodonitrotetrazolium 
(BCIP/NBT/INT, brown precipitate, DAKO, Fast Red (Red), Magenta-phos 
(magenta), Naphthol AS-BI-phosphate (NABP)/Fast Red TR (Red), Naphthol 
AS-BI-phosphate (NABP)/New Fuchsin (Red), Naphthol AS-MX-phosphate 
(NAMP)/New Fuchsin (Red), New Fuchsin AP substrate (red), p-Nitrophenyl 
phosphate (PNTP, Yellow, water solubie), VECTOR*'^ Black (black), 
VECTOR™ Blue (blue), VECTOR™ Red (red), Vega Red (raspberry red color), 

Horseradish Peroxidase (HRP, sometimes abbreviated PO) substrates 
include, but are not limited to, 2,2' Azino-di-3-ethylbtoz-thiazoline sulfonate 
(ABTS, green, water soluble), aminoethyl carbazole, 3-amino, 9-ethylcarbazole 
AEC (3A9EC, red). Alpha-naphthol pyronin (red), 4-chloro- 1 -naphthol (4C1N, 
blue, blue-black), 3,3'-diaminobenzidine tetrahydrochloride (DAB, brown), 
ortho-dianisidine (green), o-phenylene diamine (OPD, brown, water soluble), 
TAGS Blue (blue), TAGS Red (red), 3,3\5,5' Tetramethylbenzidine (TMB, green 
or green/blue), TRUE BLUE™ (blue), VECTOR'^^^ VIP (purple), VECTOR^^^ 
SG (smoky blue-gray), and Zymed Blue HRP substrate (vivid blue). 

Glucose Oxidase (GO) substrates, include, but are not limited to, nitroblue 
tetrazolium (NBT, purple precipitate), tetranitroblue tetrazolium (TNBT, black 
precipitate), 2-(4-iodophenyl)-5-(4-nitorphenyl)-3-phenyltetrazolium chloride 
(INT, red or orange precipitate), Tetrazolium blue (blue), Nitrotetrazolium violet 
(violet), and 3-(4,5-dimethylthiazol-2-yI)-2.5-diphenyltetrazolium bromide 
(MTT, purple). All tetrazolium substrates require glucose as a co-substrate. The 
glucose gets oxidized and the tetrazolium salt gets reduced and forms an 
insoluble formazan which forms the color precipitate. 

Beta-Galactosidase substrates, include, but are not limited to, 5-bromo-4- 
chloro-3-indoyl beta-D-galactopyranoside (X-gal, blue precipitate). 

The precipitates associated with each of the substrates listed have unique 
detectable spectral signatures (components). 



The following references, which are incorporated herein provide 

additional example^. Flias n oon^ FT^irM^ohivtonn^iinlMM-- \ 
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approach to diagnosis. ASCP Press (American Society of Clinical Pathologists), 
Chicago; J.F. McGinty, F.E. Bloom (1983) Double immunoslaining reveals 
distinctions among opioid peptidergic neurons in the medial basal hypothalamus. 
Brain Res. 278: 145-153; and T. Jowett (1997) Tissue In situ Hybridization: 
Methods in Animal Development. John Wiley & Sons, Inc., New York; J 
Histochem Cytochem 1997 December 45(12):1629-1641. 

Histological stains for use in transmittance microscopv: The following 
lists some histological stains used in transmitted light microscopy: eosin, 
hematoxylin, Orange G, Light Green SF, Romanowsky-Giemsa, May-Grunwald, 
Blue counterstain (Trevigen), ethyl green (CAS), Feuigen-naphthol yellow S, 
Giemsa, Methylene Blue, Methyl Green, pyronin, Naphthol-yellow, Neutral Red, 
Papanicolaou stain (which typically includes a mixture of Hematoxylin, Eosin Y, 
Light Green SF, Orange G and Bismarck Brown, Red Counterstain B (Trevigen), 
Red Counterstain C (Trevigen), and Sirius Red. 

DNA ploidv stains for use in tran.smittance microscopv: The following 
lists some DNA ploidy stains used in transmitted light microscopy. Feulgen 
reagent (pararosanilin), Gallocyanin chrom-alum, Gallocyanin chrom-alum and 
naphthol yellow S, Methyl green-pyronin Y, Thionin-Feulgen reagent, 

Immunohistoche mical stains for use in fluorescence microscopy 
Fluorescein, Rhodamine, Texas Red, Cy2, Cy3, Cy5, VECTOR Red, ELF™ 
(Enzyme-Labeled Fluorescence), CyO, CyO.5, Cyl, Cyl.5, Cy3, Cy3.5, Cy5, Cy7, 
FluorX, Calcein, Calcein-AM, CRYPTOFLUOR™'S, Orange (42 kDa), 
Tangerine (35 kDa), Gold (31 kDa), Red (42 kDa), Crimson (40 kDa), BHMP, 
BHDMAP, Br-Oregon, Lucifer Yellow. Alexa dye family, N-[6-(7-nitrobenz-2- 
oxa-1, 3-diazoI-4-yI)amino]caproyl] (NED), BODIPYtm, boron dipyrromethene 
difluoride, Oregon Green, MITOTRACKERtm Red, DiOC7(3), DilCjg, 
Phycoerythrin, Phycobiliproteins BPE (240 kDa) RPE (240 kDa) CPC (264 kDa) 
APC (104 kDa), Spectrum Blue, Spectrum Aqua, Spectrum Green, Spectrum 
Gold, Spectrum Orange, Spectrum Red, NADH, NADPH, FAD, Infra-Red (IR) 
Dyes, Cyclic GDP-Ribose (cGDPR), Calcofluor White, Tyrosine and 
Tryptophan. 

H istological stains for use in fluorescence microscopy: 4',6-diamidino-2- 

phcnvlindole ('DAPD Fo^jn F'^nrex-'Mn icrxi.; TT-rn tt . 



\_)iSA p lomv Plains !u r use m liuorcsccr iLL: inicroscogy: C hroinoniNcin A 
3. DAPI, Acriflavine-Fcuigen reaction, Auramine 0-Feulgcn rcaclion. Fthidium 
Rn^mide, Pronidium iodide, hi^li affiii'lx- HN'A ri^nr-oplinr'-^; vr^vr^ 
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BOBO, YOYO and TOTO and others. Green Fluorescent Protein fused to DNA 
binding protein, sucli as histones, ACMA, Quinacrine and Acridine Orange. 

Endogenous pigments: Hemoglobin, myoglobin, porphyrin, hemosiderin 
and other ferrous pigments, lipofiiscin, melanin, neuromelanin, ceroid a 
fluorescent oxidation product of lipid/protein, carotenoids, pyridine, flavin 
nucleotides. 

The following lists some primary antibodies known to specifically bind 
their associated cytological markers and which are presently employed as 
components in immunohistochemtcal stains used for research and, in limited 
cases, for diagnosis ui various diseases. Anti-estrogen receptor antibody (breast 
cancer), anti-progesterone receptor antibody (breast cancer), anti-p53 antibody 
(multiple cancers), anti-Her-2/neu antibody (multiple cancers), anti-EGFR 
antibody (epidermal growth factor, multiple cancers), anti-cathepsin D antibody 
(breast and other cancers), anti-Bcl-2 antibody (apoptotic cells), anti- E-cadherin 
antibody, anti-CA125 antibody (ovarian and other cancers), anti-CA15-3 
antibody (breast cancer), anti-CA19-9 antibody (colon cancer), anti-c-erbB-2 
antibody, anti-P-glycoprotein antibody (MDR, multi-drug resistance), anti-CEA 
antibody (carcinoembryonic antigen), anti -retinoblastoma protein (Rb) antibody, 
anti-ras oncoprotein (p2I) antibody, anti-Lewis X (also called GDI 5) antibody, 
anti-Ki-67 antibody (cellular proliferation), anti-PCNA (multiple cancers) 
antibody, anti-CD3 antibody (T-cells), anti-CD4 antibody (helper T cells), anti- 
CD5 antibody (T cells), anti-CD7 antibody (thymocytes, immature T cells, NK 
killer cells), anti-CD8 antibody (suppressor T cells), anti-CD9/p24 antibody 
(ALL), anti-CD 10 (also called CALLA) antibody (common acute lymphoblasic 
leukemia), anti-CD 11c antibody (Monocytes, granulocytes, AML), anti-CD 1 3 
antibody (myelomonocytic cells, AML), anti-CD14 antibody (mature monocytes, 
granulocytes), anti-CD 15 antibody (Hodgkin's disease), anti-CD 19 antibody (B 
cells), anti-CD20 antibody (B cells), anti-CD22 antibody (B cells), anti-CD23 
antibody (activated B cells, CLL), anti-CD30 antibody (activated T and B cells, 
Hodgkin's disease), anti-CD3I antibody (angiogenesis marker), anti-CD33 
antibody (myeloid cells, AML), anti-CD34 antibody (endothelial stem cells, 
stromal tumors), anti-CD35 antibody (dendritic cells), anti-CD38 antibody 



^iniiAdJjw, L iJiuu antibod\, anti-LL)95/l-as antibody (apoptosisi, anti^CDQM 
antibody (Ewings Sarcoma marker, MIC2 gene product). anti-CD 106 antibody 
rVCAM-l: ac!i\'atcd c^ndnthtdial rcll^^^ •m+i n^i.-mitMi < ^I \ 
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disease), anti-CD71 (transferrin receptor) antibody, anti-c-myc (oncoprotein and 
a hapten) antibody, anti-cytokeratins (transferrin receptor) antibody, anti- 
vimentins (endothelial cells) antibody (B and T cells), anti-HPV proteins (human 
papillomavirus) antibody, anti-kappa light chains antibody (B cell), anti-lambda 

5 light chains antibody (B cell), anti-melanosomes (HMB45) antibody (melanoma), 
anti-prostate specific antigen (PSA) antibody (prostate cancer), anti-S-100 
antibody (melanoma, salvary, glial cells), anti-tau antigen antibody (Alzheimer's 
disease), anti-fibrin antibody (epithelial cells), anti-keratins antibody, and anti- 
Tn-antigen antibody (colon carcinoma, adenocarcinomas, and pancreatic cancer). 

0 Table 2 below provides few examples of sets of markers having 

prognostic and/or therapeutic significance in various cancers: 



TABLE 2 



Cancer 


DNA 
Ploidy 


ER 


PR 


p53 


her-2/ 
neu 


Ki-67 


p2] ras 


pRB 


CD31 


Breast 


X 


X 


X 


X 


X 


X 






X 


Ovarian 


X 






X 


X 


X 






X 


Bladder 


X 






X 




X 


■1 


X 


X 


Colorectal 


X 






X 




X 


X 




X 


Prostate/ 
Bladder 


X 






X 




X 




X 


X 



A breast cancer panel therefore can include the anti-ER, anti-PR, anti- 
Her2/neu, anti-p53, anti-Ki-67 and anti-CD3I immunohistochemica! marker 
stains, a DNA ploidy stain and a H&E counterstain. 

Ovarian and/or endometrial cancer panel can therefore include the anti- 
Her2/neu, anti-p53, anti-Ki-67 and anti-CD31 immunohistochennical stains, a 
DNA ploidy stain and a H&E counterstain. 

Prostrate and/or bladder cancer panel can therefore include the anti-Ki-67, 
anti-p53, anti-CD31 and anti-retinoblastoma protein (Rb) marker stains, a DNA 
ploidy stain and a H&E counterstain. 



\ ■ 



! ■ r N [ ; ' 1 



The present irnention as herein described has several advantages o\er 
P - h h I £ h 

resolution imaging was combined with ver\^ low 
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and inefficient spectral resolution (typically two discrete spectral bands) for co- 
detection of two stains, because using a spectra collection device as herein 
described, characterized by high spatial and spectral resolutions enables to co- 
detect any desired numbers of stains even when the stains employed are very 
similar spectrally. 

Thus according to the present invention a clinician can simultaneously 
detect multiple cytological markers with prognostic/therapeutic significance (e.g.; 
ER, PR, p53, her-2/neu, Ki-67 and CD31), significant changes in DMA ploidy 
and in sample staining with conventional histological stains. The clinician can 
therefore manage and monitor patient therapy with improved accuracy (e.g., 
select appropriate therapeutic regimen), reduce patient management costs through 
more accurate diagnosis, and reduce hospital costs through more efficient 
sampling. 

Scanning fields of the stained biological sample according to the present 
inv^ nttoncarbeeffecfe J manulllyrseml-automatTcairy orautomatically, aiwell 
known in the art, using for example slide loading and scanning devices. For 
complete DNA ploidy analysis typical 200 cells, preferably more, should be 
analyzed. Pattern recognition and spectrally resolved pattern recognition 
approaches can be used to enhance analvsis and diaonn<!i<: 

The present invention, according to which a method is provided of 
simultaneous in situ analysis of a plurality of immunohistochemical stains, 
histological stains and DNA ploidy stains, using spectral imaging techniques of 
high spatial and spectral resolutions has numerous advantages over the prior art. 
First it enables simultaneous detection of a plurality of stains and therefore it is 
effort and cost-effective. Second, it enables the simultaneous detection of a 
plurality of stains on the same cells or tissue, while according to the prior art, 
these is not applicable for more than two or ihree stains. Third, it enabled 
dissociating among very similar spectra, while the prior art required the use of 
very distinctive stains. 

As specifically exemplified in the Examples section that follows, further 
according to the present invention there is provided a method of resolving 
individual stain images from a biological sample stained with at least two 
individual stains. The method accnrdinf h;^ ■y<:nrrf of <i- 



' ^-^'t-'^-' .^.1111]^.. lii .1 .^LXuiKi ..icp u\ inc luciiioc] according to liic present 
iin'cntion a calculated spectrum is calculated for each of the pixels and for each 
of the at least two independent stains, the calculated spcctrim t-n-^vii.-^r.t t^. 
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actual spectrum that would have been measured using the spectral data collection 
device had the biological sample been individually stained with one of the at least 
two individual stains. Finally, a displaying algorithm is operated on each of the 
calculated spectra for displaying each of the pixels in a calculated artificial color 
5 being equivalent to an actual color that would have been perceived for each of the 
pixels using a microscope had the biological sample been individually stained 
with the one of the at least two individual stains. 

As used herein in the specification and in the claims section that follows 
the phrase "equivalent to an actual color" is meant to indicate that the calculated 
0 color mimics the acfaa! color. Slight variation, are accepted, yet, the overall 
complexion and color distribution are recognizable. 

According to a preferred embodiment of the invention the method is 
further effected by recombining at least two of the individual stain images into a 
combined image being equivalent to an actual image that would have been 
-perceived shouM the Iridividuarsfalh imageTi^spectu^stains woul^ 
used for containing the biological sample and would have been viewed using a 
microscope. 

According to a preferred embodiment of the invention, the calculated 
spectrum is effected by calculating an absorbance spectrum for each of the pixels 
for each of the independent stains and then calculating a corresponding 
transmittance spectrum for each of the pixels for each of the stains. 

According to another preferred embodiment of the invention, an overall 
transmittance of the biological sample stained with the independent stains is 
expressed as a sum of the corresponding transmittance spectra of the independent 
2."; stains. 

According to another preferred embodiment of the invention, each 
individual stain spectrum of the independent stains is constructed by correlating 
the sum of the corresponding transmittance spectra with reference spectra of the 
independent stains. 

According to another aspect of the present invention, and as further 
exemplified in the Examples section that follows, there is provided a method of 
resolving individual stain images from a biological sample stained with at least 
two individual stains. The mcthoH ''c nffrrtP'-' ^\ m-^t^I'— 



20 



30 



^ W i ' 



cuiul:. caj^uuiicu ..pcLtruin i.^ ^aiculatco lor each ol the pixels and tor 
each of the independent stains. The calculated spectrum is equivalent to an actual 
spectrum that would have been measured lining the spec^^nl d:V^] crsV.. 
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had the biological sample been individually stained with one of the at least two 
individual stains. Finally, a displaying algorithm is operated on each of the 
calculated spectra for displaying each of the pixels in a calculated artificial color 
which is equivalent to an actual color of an equivalent additional stain as would 
have been perceived for each of the pixels using a microscope had the biological 
sample been individually stained with the additional stain. 

As used herein in the specification and in the claims section that follows, 
the phrase "equivalent additional stain" refers to a stain having a different color 
complexion, yet a similar affinity to cellular constituents and therefore similar 

opauai uibLllUUUOn. 



EXAMPLES 

Reference is now made to the following examples, which together with the 
above descriptions, illustrate the invention in a non limiting fashion. 

EXAMPLE 1 
The Measurement Apparatus and its Performances 

Figure 1 is a block diagram illustrating the main components of a prior art 
imaging spectrometer disclosed in U.S. Pat application No. 08/392,019 to Cabib 
et ai, filed Feb. 21st, 1995, now U.S. Pat. No. 5,539,517, issued Jul. 23, 1996, 
which is incorporated by reference as if fully set forth herein. 

This imaging spectrometer is constructed highly suitable to implement the 
method of the present invention as it has high spectral (Ca. 4-14 nm depending on 
wavelength) and spatial (Ca. 30/M jum where M is the effective microscope or 
fore optics magnification) resolutions. 

Thus, the prior art imaging spectrometer of Figure 1 includes: a collection 
optical system, generally designated 20; a one-dimensional scanner, as indicated 
by block 22; an optical path difference (OPD) generator or interferometer, as 
indicated by block 24; a one-dimensional or two-dimensional detector array, as 
indicated by block 26; and a signal processor and display, as indicated by block 
28. 

A critical element in system 20 is the OPD generator or interferometer 24, 



...■icLior arrax lb. Ihus. aii the required opiieal phase differences are scanned 
simultaneously for all the pixels of the field of view, in order to obtain all the 

information reouired i-o rrc-on^^Tp^.-f ^}... -ti,,. t, , . : 
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the scene are thus collected simuhaneously with the imaging information, thereby 
permitting analysis of the image in a real-time manner. ' 

The apparatus according to U.S. Pat. No. 5,539,517 may be practiced in a 
large variety of configurations. Specifically, the interferometer used may be 
5 combined with other mirrors as described in the relevant Figures of U.S. Pat. No. 
5,539,517. 

Thus, according to U.S. Pat, No. 5,539,517 alternative types of 
interferometers may be employed. These include (i) a moving type 
interferometer in which the OPD is varied to modulate the light, namely, a 

10 Fabry-Perot interferometer with scanned thickness; (ii) a Michelson type 
interferometer which includes a beamsplitter receiving the beam from an optical 
collection system and a scanner, and splitting the beam into two paths; (iii) a 
Sagnac interferometer optionally combined with other optical means in which 
interferometer the OPD varies with the angle of incidence of the incoming 

15 radiation, such as the four-mirror plus beamsplitter interferometer as further 
described in the cited U.S. patent (see Figure 14 there). 

Figure 2 illustrates an imaging spectrometer constructed in accordance 
with U.S. Pat. No. 5,539,517, utilizing an interferometer in which the OPD varies 
with the angle of incidence of the incoming radiation. A beam entering the 

20 interferometer at a small angle to the optical axis undergoes an OPD which varies 
substantially linearly with this angle. 

In the interferometer of Figure 2, all the radiation from source 30 in all the 
pixels, after being collimated by an optical collection system 31, is scanned by a 
mechanical scanner 32. The light is then passed through a beamsplitter 33 to a 

25 first reflector 34 and then to a second reflector 35, which reflects the light back 
through the beamsplitter 33 and then through a focusing lens 36 to an array of 
detectors 37 (e.g., a CCD). This beam interferes with the beam which is reflected 
by 33, then by second reflector 35, and finally by first reflector 34. 

At the end of one scan, every pixel has been measured through all the 

30 OPD's, and therefore the spectrum of each pixel of the scene can be reconstructed 
by Fourier transformation. A beam parallel to the optical axis is compensated, 
and a beam at an angle (6) to the optical axis undergoes an OPD which is a 



calculated. 

In the configuration of Figure 2 the ray which is incident on the 
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with an OPD = 0, whereas a ray which is incident at a general angle /5 - 6 
undergoes an OPD given by Equation 2: 

(1) OPD06,6,/,«) = tlir^^sirP-ifi^G))^'^ • {n^^sm^{fi^6))^-^ + 2sin/5sin6] 
where 6 is the angular distance of a ray from the optical axis or interferometer 
rotation angle with respect to the central position; / is the thickness of the 
beamsplitter; and n is the index of refraction of the beamsplitter. 

It follows from Equation 2 that by scanning both positive and negative 
angles with respect to the central position, one gets a double-sided interferogram 
for every pixel, which helps eliminate phase errors eivine morp, arrnratP rpcuitc 
in the Fourier transform calculation. The scanning amplitude determines the 
maximum OPD reached, which is related to the spectral resolution of the 
measurement. The size of the angular steps determines the OPD step which is, in 
turn, dictated by the shortest wavelength to which the system is sensitive. In fact, 
according to the sampling theorem [see. Chamberlain (1979) The principles of 
interferometric spectroscopy, John Wiley and Sons, pp. 53-55], this OPD step 
must be smaller than half the shortest wavelength to which the system is 
sensitive. 

Another parameter which should be taken into account is the finite size of 
a detector element in the matrix. Through the focusing optics, the element 
subtends a finite OPD in the interferometer which has the effect of convolving 
the interferogram with a rectangular ftinction. This brings about, as a 
consequence, a reduction of system sensitivity at short wavelengths, which drops 
to zero for wavelengths equal to or below the OPD subtended by the element. 
For this reason, one must ensure that the modulation transfer function (MTF) 
condition is satisfied, i.e., that the OPD subtended by a detector element in the 
interferometer must be smaller than the shortest wavelength at which the 
instrument is sensitive. 

Thus, imaging spectrometers constructed in accordance with the invention 
disclosed in U.S. Pat. No. 5,539,517 do not merely measure the intensity of light 
coming from every pixel in the field of view, b-Jt also measure the spectrum of 
each pixel in a predefined wavelength range. They also better utilize all the 
radiation emitted by each pixel in the field of view at any eiven time, and 



and focusing systems, and may therefore be used in a wide \aricty of 
applications, including medical diagnostic and therapy and bioloeica! research 
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applications, as well as remote sensing for geological and agricultural 
investigations, and the like. 

As mentioned above, an imaging spectrometer in accordance with the 
invention disclosed in U.S. Pat No. 5,539,517 was developed by Applied 
Spectral Imaging Ltd, Industrial Park, Migdal Haemek, Israel and is referred 
herein as SPECTRACUBE^^. 

The SPECTRACUBE"^^ system has the following or better characteristics, 
listed hereinbelow in Table 3: 

TABLE 3 



Parameter 



Performance 



Spatial resolution: 

Field of View: 
Sensitivity: 



Spectral range: 
Spectral resolution: 
Acquisition time: 
FFT processing time: 



30/M /jm (M=effective microscope or fore 
optics magnification) 
15/M millimeters 

20 milliLux (for 100 msec integration time, 
increases for longer integration times linearly 
witn V V ) 
400-1000 nm 

4 nm at 400 nm (16 nm at 800 nm) 
5-50 sec, typical 25 sec 
20-180 sec, typical 60 sec 



The SPECTRACUBE'^^ system optically connected to a microscope is 
preferably used to analyze biological samples according to the method of the 
present invention. However, any spectral imager, i.e., an instrument that 
measures and stores in memory for later retrieval and analysis the spectrum of 
light emitted by every point of an object which is placed in its field of view, 
including filter (e.g., acousto-optic tunable filters (AOTF) or liquid-crystal 
tunable filter (LCTF)) and dispersive element (e.g., grating or prism) based 
spectral imagers, or other spectral data or multi-band light collection devices 



t ^ L 1 



icquircd spectral daui. Also a device mcluding a plurality of wide-band of ( fixed 
or tunable), as described in U.S. Pat. application No. 08/917,213, filed August 25, 
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the spectral data collection device according to the present invention. Therefore, 
it is intended not to limit the scope of the present invention for use of any specific 
type of spectral data collection devices, nor any specific type of spectral imager. 

The power of the SPECTRACUBE^^ system to resolve and differentiate 
between very similar spectra is demonstrated in Figures 3-5. 

To illustrate this capability, the reader is first referred to Figures 3a-c, 
which include an example of an interphase FISH measurement performed with 
chromosome 1 and chromosome 17 specific DNA probes tagged with the 
fluorophores Texas-Red and Rhodamine, respectively, whose fluorescence 
spectra are very similar. The chromosome 1 probe was a midsatellite probe for 
the subtelomeric region of the chromosome and was tagged with Texas-Red 
linked to the DNA probe via biotin post hybridization. The chromosome 17 
probe was an a satellite probe for the centromeric region of the chromosome and 
was tagged with Rhodamine, linked to the second DNA probe via digoxigenin 
post hybridization. Figure 3a shows the original image, the way it looks to the 
eye through the microscope. Figure 3b shows the same sample, after being 
measured and processed by the SPECTRACUBE^^ system. Whereas Figure 3c 
shows the fluorescence spectra of the Texas-Red (marked as T) and Rhodamine 
(marked as R) fluorophores. 

As seen in Figure 3c, the spectral peaks of Texas-Red and Rhodamine 
differ merely by 15 nm, and therefore it would be very difficult to distinguish 
between them using a filter-based system. 

Looking at a color FISH image through a microscope as shown in Figure 
3a, the confidence level of recognizing the correct number of dots (marked 1-4) 
and of probe types appearing in the image is not particularly high. As shown in 
Figure 3b, the SPECTRACUBE^'^ system, on the other hand, taking advantage of 
the spectrum measured for each pixel, is able both to verify the existence of the 
dots, to count them exactly, and to discriminate between the different pairs with a 
high level of confidence, due to the small spectral difference between them. By 
artificial coloring of Texas-Red and Rhodamine fluorescence, as shown in Figure 
3c the location of probe specific fluorescence could be determined with high 
accuracy wherein dots 1 and 2 are of Texas-Red and dots 3 and 4 are of 



■^Kiginal linage as perceived through a microscope, i'lgure 4b shows the same 
image following a SPECTRACUBE'^ system measurement, spectral processing 
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of the six fluorophores after hybridization (marked according to the chromosomes 
each of which labels: 1, 8, 10, 1 1, 17 and X), as detected through a triple dichroic 
filter using the SPECTRACUBE^" system. For details regarding fluorophores, 
probes and chromosomes the reader is referred to the following description. 
Table 3 below and to Chroma Corp. Cat. No. 61502). 

It is apparent from Figure 4a, showing the original RGB image of the 
interphasic cell nucleus, that it is difficult to distinguish the colors from one 
another by eye or even by using a simple RGB color measurement. 

An experienced observer may, in the best case, detect three different 
colors of the six. Figure 4b, however, shows the same sample shown in Figure 
4a, after processing the spectral data with a classification algorithms, and the 
resulting dots have been highlighted with artificial colors: orange, cyan, blue, 
yellow, green, and red, while the background was given a black, artificial color. 
As observed, it is possible to see all the six pairs of fluorophores and to easily 
differentiate among the pairs. 

It should be ftirther noted that one pair, the one highlighted in blue, can 
hardly be noticed by eye, or by using a color camera, however, it is detected after 
applying a background subtraction algorithm on the spectral cube (compare 

Figures 4a and dh\ 

. ^ _ _ _ _ . _ . „ y . 

The probes used were five a satellite probes for the centromeric regions of 
chromosomes 8, 10, 11, 17 and X, and a midsatellite probe for the subtelomeric 
region of chromosome 1. The fluorophores used to label each of the above 
chromosomes and the DAPI counter stain (background), their emission peak and 
artificial displayed color classification are summarized in Table 4, below. 

From the normalized spectral signatures of each of the six fluorophores 
shown in Figure 4c, it is clear that a system based on filters measuring at a few 
relatively wide spectral ranges, is not able to differentiate reliably between the 
different probe species, because of the large overlap betw^een their spectra. Such 
a system is more dependent on the absolute measurement of the intensity of each 
probe, and therefore it is more affected by background signals and noise. It 
should be further noted that spectral overlapping sometimes occurs also with 
auto-fluorescence originating from the cell itself In this case too, the availabilit>^ 
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TABLE 4 



10 





Fluorophore 


Emission 


Displayed 






peak 


color 


8 


SpectrumOrange'^" 1 


588 nm 


Brown 


10 


SpectrumGreen^^ 1 


538 nm 


Cyan 


X 


Aqua^ 


480 nm 


Blue 


1 


Texas-Red2 


615 nm 


Yellow 


17 


FITC3 






j^j nm 


Green 


11 


Texas-Red2 + FITC3 


615, 525 nm 


Red 


backg. 


DAPl4 




Black 



15 



20 



25 



30 



' Obtained as labeled deoxynucleotides from Vysis, Downers Grove, IL, U.S.; 2 conjugated via 
-digoxigenin antibody to pre hybridized digoxigenin containing probes; 3 fluorescein-5-iso- 
thiocyanate, conjugated via anti-biotin antibody to pre hybridized biotin containing probes; 4 
4',6-diamidino-2-phenyiindole used for counter staining. 

Figures 5a-c present hybridization results of normal male chromosomes 
using a combinatorial hybridization approach in accordance with the scheme 
disclosed in U.S. Pat. application No. 09/025,131, filed February 17, 1998, which 
is incorporated by reference as if fully set forth herein. 

Figure 5a is an RGB image of the chromosome spread obtained using an 
RGB algorithm. The RGB algorithm integrates the optical signal over the 
spectral range (e.g., 400 nm to 760 nm) of the CCD array to provide an RGB 
image of the chromosomes, in which each pixel is attributed a combination of 
red, green and blue intensities according to three weighting functions, {M>r(X). 
^gW. ^bf^^)}, which correspond to the tristimulus response functions for red 
(R), green (G) and blue (B). 

In Figure 5q, the weighting functions w^-, Wg, w^, employed were simple 
square weighting functions, wherein for (red) = 640 nm and Xj = 750 nm; 
for Wg (green) Xi = 555 nm and ^2 = 640 nm; and for (blue) = 450 nm and 
'^2 = 555 nm. The simple weighting functions w^, Wg, are integrated to 
generate an RGB ima se of the chrnmnt;ome=; 



- .;iM^^i. ..uaiiatcd t!\ .1 wuis.Miicaiion aiourilhni wherein each 

pixel is classified according its .spectrum. One of the most important analysis 
algorithms is the spectral-based classification nlrnrithi- -hr - -M.,- .1.;.-] . 
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different spectra in the image to be identified and highlighted in classification- 
colors. This allows assignment of a specific classification-color to all human 
chromosomes based on their spectra. This algorithm assumes that a reference 
spectrum of each chromosome has been measured and stored in a reference 
library in the computer. A distinguishing classification-color is assigned to each 
pixel in the image according to the classification-color assigned to the reference 
spectrum that is most similar to the spectrum at that given pixel, as defined, for 
example, by a minimal square error algorithm. 

FXAMPLE 2 
Analyzing and Displaying the Results 
General: A spectral image is a three dimensional array of data, I(x.y,Z), 
that combines spectral information with spatial organization of the image.' As 
such, a spectral image is a set of data called a spectral cube, due to its 
dimensionality, which enables the extraction of features and the evaluation of 
quantities that are difficult, and in some cases even impossible, to obtain 
otherwise. Since both spectroscopy and digital image analysis are well known 
fields that are covered by an enormous amount of literature [see, for example, 
Jain (1989) Fundamentals of Digital Image ProcessinP Pr^ntir.-U.ii 
International], the following discussion will focus primarily on the benefit of 
combining spectroscopic and imaging information in a single data set i.e., a 
spectral cube. 

One possible type of analysis of a spectral cube is to use spectral and 
spatial data separately, i.e.. to apply spectral algorithms to the spectral data and 
two-dimensional image processing algorithms to the spatial data. 

As an example of a spectral algorithm, consider an algorithm computing 
the similarity between a reference spectrum and the spectra of all pixels (i.e., 
similarity mapping) resulting in a gray (or other color) scale image (i.e., a 
similarity map) in which the intensity at each pixel is proportional to the degree 
of 'similarity'. This gray scale image can then be further analyzed using image 
processing and computer vision techniques (e.g., image enhancement, pattern 
recognition, etc.) to extract the desired features and parameters. In other words, 
similarity mapping involves computing the intecrnl of the :\Unh^.tr vn\ f -t^ ' 



••"^ : .ir:a^:c,. aiiu tii^pia) iii^: d era} lc\ci or 

pseudocolor (black and white or color) image. ,n which \hc bright pixels 
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5 



10 



15 



10 



25 



30 



correspond to a small spectral difference, and dark pixels correspond to a large 
spectral difference, or vice versa. 

Similarly, classification mapping perform the same calculation as 
described for similarity mapping, yet takes several spectra as reference spectra 
and pamts each pixel of the displayed image with a different predetemiined 
pseudocolor, according to its classification as being most similar to one of the 
several reference spectra. 

It is also possible to apply spectral image algorithms based on non- 
separable operations; i.e., algorithms that include both local spectral information 
and spatial correlation between adjacent pixels (one of these algorithms is, as will 
be seen below, a principal component analysis). 

One of the basic needs that arise naturally when dealing with any three- 
dimensional (3D) data structure such as a spectral cube (i.e., I{xj;,A)X is 
visualizing that data structure in a meaningful way. Unlike other types' of 3D 
data such as topographic data, D(x,y.z), obtained for example by a confocal 
microscope, where each point represents, in general, the intensity at a different 
location (x.y.z) in a tree-dimensional space, a spectral image is a sequence of 
images representing the intensity of the same two-dimensional plane (i e the 
sample) at different wavelengths. For this reason, the two most intuitive v..v. tn 
view a spectral cube of data is to either view the image plane (spatial data) or the 
mtensity of one pixel or a set of pixels as function of wavelength in a three- 
dimensional mountain-valley display. In general, the image plane can be used for 
displaying either the intensity measured at any single wavelength or the gray 
scale image that results after applying a spectral analysis algorithm, over a 
desired spectral region, at every image pixel. The spectral axis can, in general, be 
used to present the resultant spectrum of some spatial operation performed in the 
vicinity of any desired pixel (e.g., averaging the spectrum). 

It is possible, for example, to display the spectral image as a gray scale 
image, similar to the image that might be obtained from a simple monochrome 
camera, or as a multicolor image utilizing one or several artificial colors to 
highlight and map important features. Since such a camera simplv integrates the 
optical signal over the spectral range (e.g., 400 nm to 760 nm) of Ihe CCD array, 
the 'equivalent' monochrome CCD camera image can he comruf?d fron, .h,. 
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In equation 2, M>a) is a general weighting response function that provides 
maximum flexibility in computing a variety of gray scale images, all based on the 
mtegration of an appropriately weighted spectral image over some spectral range 
For example, by evaluating equation 2 with three different weighting functions. 
{wrai wga), wi,a)}, corresponding to the tristimulus response functions for 
red (R), green (G) and blue (B). respectively, it is possible to display a 
conventional RGB color image. It is also possible to display meaningful non- 
conventional (pseudo) color images. Figure 6 presents an example of the power 
of this simple algorithm. Consider choosing {v.,, w„, vv^} to be Gaussian 

functions distributed "inside" a sner.tnim mw^ct .i,^ . 

4 w*vwiwuL, in%^ iv^ouuiii^ pscuuo-coior 

image that is displayed in this case emphasizes only data in the spectral regions 
corresponding to the weighting functions, enabling spectral differences in these 
three regions to be detected more clearly. 

Point operations: Point operations are defined as those that are performed 
on single pixels, (i.e., do not involve more than one pixel at a time). For 
example, in a gray scale image, a point operation can be one that maps the 
intensity of each pixel (intensity function) into another intensity according to a 
predetermined transformation function. A particular case of this type of 
transformation is the multiplication of the intensity of each oixei hv . .onc^..t 
Additional examples include similarity and classification mapping as described 
hereinabove. 

The concept of point operations can also be extended to spectral images' 
here each pixel has its own intensity function (spectrum), i.e., an n-dimensional 
vector ViiA); A€[Ai, ^n]- A point operation applied to a spectral image can be 
defined as one that maps the spectrum of each pixel into a scalar (i.e., an intensity 
value) according to a transformation fiinction: 

n = giV\i^));Ae[A\,An] (3) 
Building a gray scale image according to Equation 3 is an example of this 
type of point operation. In the more general case, a point operation maps the 
spectrum (vector) of each pixel into another vector according to a transfonnation 
function: 

^2(0 = g( V] (A))- le[\,N],Zs[Ai, ^] (4), where < 
In this case a spectral image is transformed into annther <;ncctr-.i i-... 



..'.Ilk IV 



' ""^ ''^ '^ ' i ^ .^^niLdj uci]Nii\ anal\MN upnca^ 

density ,s cniployed to highlight and graphically represent regions^ of an object 
being studied spcctroscopically with higher dvnamic ranee than the tMn.-^..io.^ 
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spectrum. The optical density is related to transmission by a logarithmic 
operation and is therefore always a positive ftinction. The relation between the 
optical density and the measured spectra is given by Beer Lambert law: 

^^W = -Jog.o^ = -log,„rW (5) 

where ODiA) is the optical density as a fiinction of wavelength, I{X) is the 
measured spectrum, I^iA) is a measured reference spectrum, and t(;i) is the 
spectral transmittance of the sample. Equation 5 is calculated for every pixel for 
every wavelength where I^iA) is selected from (1) a pixel in the same spectral 
cube for which OD is calculated; (2) a corresponding pixel in a second cube; and 
(3) a spectrum from a library. 

Note that the optical density does not depend on either the spectral 
response of the measuring system or the non-uniformity of the CCD detector. 
This algorithm is useful to map the relative concentration, and in some cases the 
absolute concentration of absorbers in a sample, when their absorption 
coefficients and the sample thickness are known. 

Additional examples include various linear combination analyses, such as, 
but not limited to, (i) applying a given spectrum to the spectrum of each of the 
pixels in a spectral image by an arithmetical ftinction such as addition, 
subtraction, multiplication division and combinations thereof to yield a new 
spectral cube, in which the resulting spectrum of each pixel is the sum, 
difference, product ratio or combination between each spectrum of the first cube 
and the selected spectrum; and (ii) applying a given scalar to the spectra of each 
of the pixels of the spectral image by an arithmetical function as described above. 

Such linear combinations may be used, for example, for background 
subtraction in which a spectrum of a pixel located in the background region is 
subtracted from the spectrum of each of the pixels; and for a calibration 
procedure in which a spectrum measured prior to sample analysis is used to 
divide the spectrum of each of the pixels in the spectral image. 

Another example includes a ratio image computation and display as a gray 
level image. This algorithm computes the ratio between the intensities at two 
different wavelengths for every pixel of the spectral image and paints each of the 
pixels in a lighter or darker artificial color accordingly. For example, it paints the 



analysis methods mcrUioned above, algorithms arc applied to the spectral data. 
The importance of displaying the spectrally processed data as an imaee is mostly 
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qualitative, providing the user with a useful image. It is also possible, however, 
depending on the application, to use the available imaging data in even more 
meaningful ways by applying algorithms that utilize the spatial-spectral 
correlation that is inherent in a spectral image. Spatial-spectral operations 
represent the most powerful types of spectral image analysis algorithms. As an 
example, consider the following situation: 

A sample contains k cell types stained with k different stains (the term 
•cell- here is used both for a biological cell, and also as 'a region in the field of 
view of the instrument'). Each stain has a distinct spectrum and binds to only one 
of the k cell types. It is important to find the average intensify pei ceil for each 
one of the k cell types. To achieve this task the following procedure can be used: 
(i) classify each pixel in the image as belonging to one of /t+1 classes {k cell types 
plus a background) according to its spectrum; (2) segment the image into the 
various cell types and count the number of cells from each type; and (3) sum the 
spectral energy contributed by each class, and divide it by the total number of 
cells from the corresponding class. 

This procedure makes use of both spectral and spatial data. The relevant 
spectral data takes the form of characteristic cell spectra (i.e., spectral 
"signatures"), while the spatial data consists of data about various tvn^-. ..w. 
(i.e.. cell blobs) many of which appear similar to the eye. In the above situafion, 
cells can be differentiated by their characteristic spectral signature. Hence, a 
suitable point operation will be performed to generate a synthetic image in which 
each pixel is assigned one of k+1 values. Assuming that the spectra of the 

different cell types are known to be si{X)- i = I, 2, , k, Ze[Ai, A^], and the 

measured spectrum at each pixel (x,;;) is s_^^y{A), Ag[Ai, ^nl then the following 
algorithm is a possible method of classification (step 1 above): 

Let e2. be the deviation of the measured spectrum from the known 
spectrum of the stain attached to cell type /. Then, adopting a least-squares 
"distance" definition, one can write: 

ef = Y.(sU)-sM)y (6) 

where is the spectral region of interest. Each point [pixel (x, y)] in the image 
can then be classified imo one of the ^+1 classes using the following criterion: 



IHi:nUY._v) eia>s il ■ llirc>h()ld. and /;■ is such that niinlc^,] - c- , 

it ^ I 
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Steps 2 and 3 above (image segmentation and calculation of average 
intensity) are now straight- forward using standard computer vision operations on 
the synthetic image created in accordance with the algorithm described in 
equations 6 and 7. 

Another approach is to express the measured spectrum s^^yiA) at each 

pixel as a linear combination of the k known fluorescence spectra ^/(A); / = 1,2, 

» ^- In this case one would find the coefficient vector C = [c\, C2, , c^] 

that solves: 

F-min^(^(A)-^(A))- (8) 

where s{A) = Y^c, ■ s,(X), 

1-1 

dF 

Solving for —=0:for i=].2 ^(i.e., find values of c/ which minimize F) 

yields the matrix equation C=A-'B (9), where ^ is a square matrix of dimension 

mm- _ 



k with elements = 



(10), and B is a vector defined as 



m,n = 1,2,... ,A: (11). 



Arithmetic operations may similarly be applied to two or more spectral 
cubes and/or spectra of given pixels or from a library. For example consider 
applying an arithmetic operations between corresponding wavelengths of 
corresponding pairs of pixels belonging to a first spectral cube of data and a 
second spectral cube of data to obtain a resulting third spectral cube of data for 
the purpose of, for example, averaging two spectral cubes of data, time changes 
follow-up, spectral nonnalization, etc. 

In many cases objects (e.g., cells) present in a spectral image differ from 
one another in chemical constituents and/or structure to some degree, especially 
when stained. Using a decorrelation analysis, such as a principal component 
analysis, by producing covariance or a correlation matrix, enhances these 
differences. Decorrelation statistical analysis is directed at extracting 
decorrelatcd data out of a greater amount of data, and average over the correlated 
Dortions thereof There are a mimber of rrlntoH stntiQtjrni ^Vrr-^r-r-r-r,^; ,>~,.fi, 



^ ' -~ pciiKip^ liiuic Loihinoii owe. and uncu acL\>i-Uine to Ihc 
present invention for decorrelation of spectral data, as this tcnn is defined above. 
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However, considering the fact that all decorrelation statistical methods including 
those listed above are related to one another, there is no intention to limit the 
scope of the invention to use of any specific decorrelation method. Specifically 
there is no intention to limit the scope of the present invention to use of principal 
component analysis, as any other decorrelation statistical method may be 
alternatively employed. Information concerning the use and operation of the 
above listed decorrelation statistical methods is found in R. A. Johnson and D. W 
Wichen, "Applied Multivariance Statistical Analysis, third edition. Prentice Hall 
(1992) and T. W. Anderson, An Introduction to Multivariance Statistical 
Analysis, second edition, Wiley and Sons (1984). both ^re inrn^..^..^ u.. 
reference as if fully set forth herein. 

Furthermore, as will become apparent from the descriptions to follow the 
implementation of a decorrelation statistical method may be done using various 
modifications. As the concept of the present invention is not dependent upon any 
specific modification, it is the imention that the scope of the present invention 
will not be limited to any specific modification as described below. 

A brief description of the principal component analysis using a covariance 
matrix is given below. For further details regarding the principal component 
analysis, the reader is referred to Martens and Naes (1989) Multivariate 
Calibration, John Wiley & Sons, Great Britain; and to Esbensen et a!., Eds 
(1994) Multi variance analysis - in practice. Computer-aided modeling as 
CAMO, and the Unscrambler's User's guide. Trondheim, Norway. 

Thus, the intensities of the pixels of the image at wavelength Xi (i = 1 ....N) 
are now considered a vector whose length is equal to the number of pixels q 
Since there are N of these vectors, one for every wavelength of the measurement, 
these vectors can be arranged in a matrix B' with q rows, and N columns: 



No. of wavelengths 
"^w • • • 



- No. of pixels 



(12) 



-ii.a a NL'comi iioniuilized matrix B defined as: 



wo 00/31534 



PCT/US99/27000 




73 

No. of wavelengths 
^u/ . . . ■ 

B = No. of pixels ■ (14) 

A covariance matrix C is defined for the matrix B: C = bTb of 
dimensions A^xA^. C is diagonalized, and eigenvectors and eigenvalues related by: 
C V'i = Vi where Vi are N orthogonal unit vectors and /i/ are the eigenvalues 
representing the variance in the direction of the z-th unit vector F/. In general, the 
lowest components represent the highest variability as a function of pixels. 

The products BVi (i = 1,...A0 are the projections of the spectral image onto 
the elements of the orthogonal basis, They are vectors with q elements (q = 
number of pixels), and can be displayed separately as black and white images. 
These images may reveal features not obvious from a regular black and white 
image filtered at a certain wavelength or wavelength range. 



EXAMPLE 3 
Materials and Methods 

Breast cancer: 

Sample: All samples were obtained by from a 79 woman suffering from 
infiltrating ductal carcinoma, moderately differentiated. Samples were 
cross sectioned and prepared for staining following conventional protocols. 

Stainins protocols: Staining was perfonned following standard Vantana 
or DAKO automated immunostaining protocols. 

Measurement: A microscope (Nikon Eclipse E-800) connected to a 
SPECTRACUBE™ system was adjusted for Kochler illumination with 
transmitted light lamp power to maximum voltage (12 V) for most stable 
illumination. Neutral density and color filters (FG3 and anti reflection filters) 
were introduced in the optical path to adjust intensity and spectral color balance. 
SPECTRACUBE acquisition parameters were 300 frames, 512 virtual frames, 



li^cU U) lorni pure d>es spccirai iihrarv 
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Then spectral cubes of each of the samples were acquired. And the 
SPECTRACUBE™ algorithms SpyView, as described in the SPECTRACUBE™ 
manual were employed to obtain RGB images, gray-level images of each spectral 
component, threshold binarized images and composite classification images 
thereof. 

Cervix cancer: 

Sample: A pap smear of a middle aged woman was collected following 
conventional procedures. 

Staining protocols: Staining was essentially as described in G. 
Papanicolaou (1942) A new orocedure for staininp vapinal QmparQ ^n\f^nn^ 
95: 438-439, which is incorporated by reference as if fully set forth herein. 

Measurement: A microscope (Nikon Eclipse E-800) connected to a 
SPECTRACUBE™ system was adjusted for Koehler illumination with 
transmitted light lamp power to maximum voltage (12 V) for most stable 
illumination. Neutral density and color filters (FG3 and anti reflection filters) 
were introduced in the optical path to adjust intensity and spectral color balance. 
SPECTRACUBE acquisition parameters were 300 frames, 512 virtual frames, 
wavelength range 440 to 760 nm, 176 ms/frame. 

First, "pure dye" i.e., Harris hematoxylin, eosin, orange G, light green SF 
and Bismark brown Y (each stain alone) spectral cubes were acquired and 
representative spectra therefrom were used to fonn pure dyes spectral library. 

Then spectral cubes of the cervix cancer sample were acquired. And the 
SPECTRACUBE™ algorithms SpyView, as described in the SPECTRACUBE'^'^ 
manual were employed to obtain RGB images, gray-level images of each spectral 
component, threshold binarized images and composite classification images 
thereof 

EXAMPLE 4 
Experimental Results 

Two well characterized experimental models served to demonstrate the 
feasibility and applicability of the methods according to the present invention: 
breast cancer and cervix cancer samples. 

Figure 7 presents non-normalized spectra of two histoloeical ^tain^ 

\hc right. Please note that each of the stains has a characterizing spectrum. 
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which, as further exempHfied hereinbelow, enables simultaneous co-detection of 
spectral components associated with each of which. 

Figures 8-1 1 show such experiments. All images were measured using the 
SPECTRACUBE™ system and its various measurement and analysis algorithms, 
5 as described hereinabove. 

Figures 8a-e show images of a breast cancer sample which was previously 
and independently determined to be ER(+)/PR(-f). The sample was co-stained 
with the histological stain hematoxylin and with the immunohistochemical stain 
anti-ER-DAB. Figure 8a presents an RGB image of the sample, using the RGB 

10 algorithm described hereinabove v/ith respect to Figure 6. Figures 8b-d present 
binarized images of hematoxylin, DAB and AEC spectral components, 
respectively. These binarized images were obtained by thresholding gray-scale 
images showing the intensity of each component in each pixel. Figure 8d serves 
as a simulation for a PR(-) tumor. Figure 8e presents a classification overlay 

15 image, wherein the above spectral components are highlighted in red, green and 
blue, respectively. Please note that as expected no AEC spectral components are 
detectable, yet, spectral components of both hematoxylin and DAB are readily 
detectable. The classification image assists the pathologist in evaluating the 
presence/absence/aggression level/diagnosis and/or prognosis of cancer cells or 

20 tissue examined. 

Figures 9a-e show images of a breast cancer sample which was previously 
and independently determined to be ER(+)/PR(+). This sample was also co- 
stained with the histological stain hematoxylin and with the 
immunohistochemical stain anti-PR-AEC. Figure 9a presents an RGB image of 

25 the sample. Figures 9b-d present binarized images of hematoxylin, DAB and 
AEC spectral components, respectively, whereas Figure 9c presents a 
classification overlay image, wherein the above spectral components are 
highlighted in red, green and blue, respectively. Please note that as expected no 
DAB spectral components are detectable, yet, spectral components of both 

30 hematoxylin and AEC are readily detectable. 

Figures lOa-e show images of a breast cancer sample which, like the 
former sample, was previously and independently determined to be 



-^b- ' ■anijiiv 1 iL^Liic^ jMlvii t':c:^ciu iMndii/cu iniauc^ dI ticniaiowim 
DAB and Fast Red spectral components, respectively. Figure 10c presents a 
classification overlav imaee. wherein the aho\'e spectral componcrts nr^^ 
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highlighted in red, green and blue, respectively. Please note that as expected no 
DAB spectral components, except for the artifact crystals formed especially in the 
lower part of the field, are detectable in this sample, yet, spectral components of 
both hematoxylin and Fast Red are readily detectable. 

Figures lla-e show images of a breast cancer sample which was 
previously and independently determined to be ER(+)/PR(+). The sample was 
co-stained with the histological stain hematoxylin and with the 
immunohistochemical stains anti-ER-DAB and anti-PR-Fast Red. Figure 11a 
presents an RGB image of the sample. Figures 1 Ib-d present binarized images of 
hematox>^liii, DAB and Fast Red spectral components, respectively. Figure 1 ie 
presents a classification overlay image, wherein the above spectral components 
are highlighted in red, green and blue, respectively. Regions co-stained with anti- 
ER-DAB and anti-PR-Fast Red are shown in yellow. Please note that as 
expected hematoxylin, DAB, as well as Fast Red spectral components are readily 
detectable. 

Figures 12a-f show images of a breast cancer sample which was 
previously and independently determined to be ER(4-)/PR(+). The sample was 
co-stained with the histological stains hematoxylin and eosin and with the 
immunohistochemical stains anti-ER-DAB and anti-PP.-Fast Red. Figure 12a 
presents an RGB image of the sample. Figures 12b-e present binarized images of 
hematoxylin, eosin, DAB and Fast Red spectral components, respectively. Figure 
12f presents a classification overlay image, wherein the above spectral 
components are highlighted in blue, purple green and red, respectively, showing 
the ability of the SPECTRACUBE™ system to resolve four different spectral 
components. Thus, this example shows a stained breast cancer tissue section 
simultaneously showing staining to nuclei (hematoxylin), cytoplasm (eosin), 
estrogen receptor (ER, detected with anti-ER/HRP/DAB), and progesterone 
receptor (PR, detected with anti-PR/HRP/DAB). In the images show some ER(+) 
cells and fewer PR(+) cells. Different areas on entire slide represent interductal 
(ER(+)/PR(+)) and intraductal (ER(+)/PR(-)) carcinoma. This image shows a 
duct, so mostly ER(+)/PR(-) cancer cells were expected. 

Figure 13 presents non-normalized spectra of five histological stains 



i i^Ki-L Mi^'W !:ii.:ucs ul d Lcv\\\ LdUL'ci :^anipic co-^ilaiiicii wiiii Ihc 

histological stains Harris hematoxylin, eosin. orange G, liizht ereen SF and 
Rismark hrown Y, which collcctivclv fonr what known in t^;-- ^rt 
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Papanicolaou (Pap) stain. Figure 1 4a presents an RGB image of the sample. 
Figures 14b-f present binarized images of Haitis hematoxylin, qosin, orange G, 
light green SF and Bismark brown Y spectral components, respectively. Figure 
I4e presents a classification overlay image, wherein the above spectral 
5 components are highlighted in blue, pink, orange, green and gray, respectively, to 
form by combinations thereof the colorful classification overlay image shown. 
Please note that each of the stains employed has a unique staining pattern which 
could be resolved only due to the high spectral and spatial resolutions of the 
SPECTRACUBE™ system employed. 
10 The data presented herein demonstrates the usefulness of a device liaving 

high spectral and spatial resolutions in the analysis of biological samples co- 
stained with multiple stains. 

It will be appreciated by one ordinarily skilled in the art that the algorithms 
and displays used under this example, can be replaced by numerous other 
15 algorithms and displays, one example being the linear decomposition algorithm 
described in U.S. Pat. No. 08/984,990, which is incorporated by reference as if 
fully set forth herein. Using this algorithm will enable a researcher to obtain 
otherwise very similar and indicative results. 

In the above example it has been shown how the spectral imaee of a tk^np 

A - - - — — 

20 section stained simultaneously with a plurality of stains, illuminated with white 
light and measured in transmission under a microscope, can be analyzed to obtain 
an image in which each stain is represented distinctively and separately. 

The ability to analyze multiple stains present in one biological sample 
speeds up and enhances the process of identifying potentially cancerous cells on 

25 one hand, and conser\^es scarce biological material on the other hand. 

In addition, in the case of treatment with multiple immunohistochemical 
stams, this method of stain separation provides new information, unavailable so 
far in the art, namely the presence and concentration of all the tested markers in 
each single cell examined. This information can enhance the accuracy of cancer 

30 diagnosis and other pathogenic disorders and may improve prognosis and 
treatment. 

In the above example images representing tissue sections probed with 
several stains, each represented separatelv and distinctiveh' n c-riv e^ni^ Ip. pI 



non-conformit>\ The practice of deciphering images with pathological 
importance was established based on many vears of experience of individual^ 
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correlating the images as seen through the microscope with the pathological state 
of the cells/tissues examined. Simply put, pathologists are not familiar with the 
format of the images as presented in the above example, and, as a resuh, prior to 
an extensive training period, utilizing the technology described is relatively 
cumbersome. 

According to this aspect of the present invention, measurement and 
analysis procedures are described, combining the advantages of the previous 
technology with formats of display that the practicing pathologist is familiar with, 
thereby, significantly improving the usefulness thereof 

This is achieved, according to the present aspect of the iiivenlion, by 
staining the tissue with a plurality of stains, such as a plurality of histochemical 
stains, simultaneously, performing a spectral image measurement, calculating the 
spectrum of each pixel as it would have been measured had the tissue been singly 
stained with each one of the stains employed, and finally displaying each pixel in 
a color as calculated on the basis of its spectrum, similar, or preferably 
substantially identical to the natural color of the respective stain. 

The final image, obtained implementing the present invention, includes a 
series of color images, each representing one of the stains as would have 
appeared if had been solely employed and viewed by means of a conventional 
CCD supplemented microscope. Presentation can acquire one of various forms, 
including, but not limited to, in succession, simultaneous, and/or superimposed 
images. 

The Beer-Lambert's law states that given the absorption coefficient of a 
given stain, its concentration and thickness can then be calculated by measuring 
both the light incident on, and collected from this stain. 

!{a) = I,{z)'\0-'^'^" (15) 

Equation 15 above describes this relationship, and it is applicable 
separately to each wavelength (A), wherein Iq(A) is the incident flux on the 
sample, 1(A) is the exiting flux from the sample, is the absorption coefficient 
of the absorbing molecule, namely the stain, c is its concentration and / the 
thickness of the sample. Mnder ^he nqt^MTTipti^^ cmi^nr^^r^ nr^ri -irr.^ 
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When the sample contains several spectrally different stains, and in the 
absence of interactions between the stains which can lead to variations in the 
optical density of each of the stains, the exiting flux can then be expressed as in 
Equation 15, except that the overall optical density A(A) of the multi-stain sample 
5 is now expressed as a sum of the optical densities of the different stains present in 
the sample (Equations 16 and 17): 



4^)=jl^M'Crl, (16) 

10 I{a)^I,{a)']Q''^'^ (17) 

where, effA), ci, and If are the individual spectral absorption coefficient, the 
concentration and sample thickness of stain / respectively. Since in the case, 
demonstrated by a biological sample fixed on a microscope slide, the thickness, 
15 //, is the same for all stains. By applying the following equation, c/, the 
concentration of the relative stain in the sample, can be extracted individually. 

The term A (A) of Equation 16 can be expressed using Equation 17 to yield 
Equation 18 as follows: 



20 



25 



.0 



10 



(18) 



It will be appreciated that Equations 15 to 18 are valid for every single 
pixel of the sample. Thus, for a sample containing M stains, these Equations 
enable the calculation of the concentration, c/, of each individual stain of the M 
stains, for every pixel of the sample, assuming that I^fA) and 1(A) are measured 
for every pixel, and all the absorption spectra, 6j{A), of the stains used in for 
staining are known, either from the literature or from dedicated reference 
measurements. 

The c/'s in Equation 16 are A/ unknowns, and in principle, if one measures 
the spectra with exactly M resolution elements, one obtains M linear equations 
which, in general, have a unique solution. In practice, higher spectral resolution 

\v\]] he u^rrl in cnninnrtion \\'^th hnf:i r^^r-l■,^ rn^tTo ,>,,.tv . f .i i,; \. . ^ 



:.ai]4")ic 1^ -^Ldiiicu \\i:n oin\ sUiiii , anu ui^ii rcprc^cnlcd b\- i'.qualioii \\) 
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B{A) = I,(A)^]0-''''''^'' (19) 

Following this calculation, once the c/'s are known, each individual stain 
spectral image can be constructed by correlating the above calculations with the 
known spectrum of the stain obtained either from the literature or from dedicated 
reference measurements. 

As can be seen from Equation 18, it is clear that the resulting specific 
concentration of stain for each pixel is highly dependent on an accurate 
knowledge of Iq{A), because this function, the spectrum of the exiting light, 
appears in the denominator. In fact, for incident wavelengths at which the light 
efflux, Iq{X), is relatively small, the result is unreliable owing to the possible in 
distinction from background noise. 

As a result, measurement of Iq(A) must be performed with the most 
accurate method. 

Several options are available, including, but not limited to, (i) measuring 
the spectrum of the microscope lamp by removing the microscope slide and 
taking a measurement; (ii) measuring a slide without tissue; (iii) measuring a 
slide and cover slip with an unstained tissue section. 

As was experimentally determined and as is shown in Figure 15, the 
results obtained are the same in all of these cases. 

This indication is important, not only because it enables flexibility to 
select whichever method one deems most convenient, but also because it 
confirms the fact that the contribution to the final transmission spectrum of all 
components but the stain(s) themselves is negligible. 

Figure 16 shows a number of non-normalized optical density spectra 6i(A) 
• cj • li of several common histochemical stains: eosin, fast red, DAB, 
hematoxylin and X-gal, as measured individually using the SPECTRACUBE^^ 
and implementing Equation 18. 

Each spectrum was measured from a singly stained slide, while the 
reference spectrum for each stain was measured from an area of the respective 
slide that appeared to be substantially unstained. This method proved to be 
satisfactor}'. As expected from the literature, the eosin stained slide turned out to 
be relatively quite bright (because of low absorption) while the DAB stained slide 
displayed reeions that Innked brown-Hlnrk nnHor T^T;,-r,>r,-- -,r^,-> i^ - . * \r. i 
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microscopy. For example, Fast Red absorbs mainly the green and some blue 
light, so it displays red color. 

The following provides a simplified step by step procedure for spectrally 
resolving individual stains from a sample stained with a plurality of stains. 
5 First, the illumination spectrum Iq(A), is measured. 

Second, the spectral image of the stained sample to be analyzed is 
measured. 

Third, using Equations 16 to 18 and previous or acquired knowledge of 
the absorption spectra of the individual stains employed, the optical densities of 
10 each of the stains is calculated pixel by pixel as a function of wavelength. 

Fourth, using Equation 19 for calculating the transmission spectrum of 
each of the stains employed pixel by pixel. 

Fifth, a standard RGB algorithm is used to calculate the color as would 
have been seen by the eye through a conventional microscope for each of the 
15 stains pixel by pixel. 

Finally, RGB images of each of the stains employed for staining the 
analyzed sample are displayed. 

Figures 17 through 29 demonstrate the present aspect of the invention 
implemented on prostate tissue section co-stained with two histological stains: 
20 hematoxylin and eosin (Figures 17-22), and on uterus tissue section co-stained 
with three histological stains: BCIP-NBT, Vecor SO and Nuclear Fast Red 
(Figures 23-29). 

Figure 17 shows an RGB image of a prostate tissue section co-stained with 
hematoxylin and eosin. This image is identical to the image that is seen while 

25 viewing the same sample using conventional transmittance microscopy. The 
contributions of each of the stains employed to the color complexion obtained in 
the image are in some regions obvious, however, in other regions, where 
intensive co-staining had taken place, it is difficult to determine the intensity of 
the lighter hematoxylin stain. 

30 Figures 18-19 show the resolved images of hematoxylin and eosin 

obtained using the algorithm according to this aspect of the present invention. In 
other words, linear decomposition was employed to resolve intensity images for 
each of the stains whrrrin H^^htcT* rnmrVv'on ;o,i;r-,t;,-o r--t- ^ , 



1 iguic^ ^,u-^: :.iu)\^ [nc rc^oUco iniagc:. ol Mcinalox\iin aiKl cusin 
obtained followmg the implementation of EquaLion 19 hereinabove. The results 
are striking. Implementing the described procedure en.'ibled cow.v^c^^- y>-.■f^]v:]^^^^ 
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of each of the stains employed and presentation thereof in individual images 
mimicking their expected appearance should each of which had been employed 
solely. 

Figure 22 further demonstrates the accuracy of the employed procedure. 
5 Upon reintegration and reconstitution of the spectral data calculated to present 
the images shown in Figures 20-21 using a reverse algorithm operated following 
the above equations in the reverse order, one obtains complete recovery of the 
RGB image of Figure 17. In addition, this procedure "cleans" or "idealizes'' the 
results, so as to remain with spectral contributions substantially solely of the 
10 stains employed. 

In addition, when reintegrating, the relative contribution of a stain to an 
image can be controlled. For example, the individual contributions of 
hematoxylin and eosin stains to a hematoxylin and eosin co-stained sample can be 
independently controlled by first resolving each of the stains as herein described 

15 and then reintegrating them while changing the intensity thereof as required to 
correct for improper original staining. 

This feature of the present invention may find uses when among the 
plurality of stains employed, two or more stains are typically used in combination 
for staining. In other words, one can resolve each of the stains and then 

20 recombine any subset thereof to achieve an image mimicking this subset of stains 
as would have been seen using conventional microscopy. 

Figure 23 shows an RGB image of a uterus tissue section co-stained with 
BCIP-NBT known to stain epithelium, Vecor SG, known to stain smooth muscle, 
and Nuclear Fast Red, known to stain nuclear components. This image is 

25 identical to the image that is seen while viewing the same sample using 
conventional transmittance microscopy. The contributions of each of the stains 
employed to the color complexion obtained in the image are in some regions 
obvious, however, in other regions, where intensive containing had taken place, it 
is difficult to determine the intensity of the lighter Vecor SG and Nuclear Fast 

30 Red stains. 

Figures 24-26 show the resolved images of BCIP-NBT, Vecor SG and 
Nuclear Fast Red obtained using the algorithm according to this aspect of the 
present invention. In other words, linear decomposition was cmploved to resolve 

- ■ ■ r " ( ' ( ' I 1 I 1 ^ r ■ > ■ 1 . ■ ; ■: , * ■ f ■ . ' . 1 J ■ t ■ , ■ ■ . . , . , . , . , 

Figures 27-29 show the resolved images of BCIP-NBT, Vecor SG and 
Nuclear Fast Red obtained following the implementation of Equation 19 
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hereinabove. Again, the results are striking. Implementing the described 
procedure enabled complete resolution of each of the stains • employed and 
presentation thereof in individual images mimicking their expected appearance 
should each of which had been employed solely. 

The present aspect of the invention can be used for what is referred to 
herein as equivalent stain replacement. It is well known that stains featuring 
different complexions in many cases share similar or substantially identical 
spatial distribution due to similar intereaction types with cellular components. 
However, in many applications, the pathologist is used to seeing one stain but not 

the other. Yet, when containing with a nlnralitv nf ctairwc ;c ch^,^^*^^ 

restrictions are expected for stains selection, which are preferably selected having 
as less as possible similar spectra. Other considerations, such as, cost 
effectiveness may also influence stain selection. The present aspect of the 
invention provides effective means for transforming a representation of a stain, 
either resolved from a plurality of stains, or solely employed, into a stain format 
to which the trained pathologist is accustomed. 

Thus, according to the present invention, a characteristic stain color 
unfamiliar to the user can be replaced by another, biologically equivalent stain, 
having distinctively different color characteristics, more familiar to the user, 
thereby to display the resulting image as if the sample was stained with the more 
familiar stain. 

This is effected according to the present invention by either selecting an 
RGB algorithm dedicated to a specific color transformation or a dedicated color 
transformation algorithm which includes transformation factors, one for each 
wavelength, the multiplication thereof with the respective wavelengths' 
intensities of the unfamiliar stain, results in corresponding intensities of the 
familiar stain and thereby a transformed spectrum is obtained. The transformed 
spectra, which are calculated independently for each pixel, are similar to the 
spectra of the familiar stain, should the latter had been used for staining. The 
conventional RGB algorithm can now be used for displaying the image as if it 
had been stained with the familiar stain. 

Thus, this aspect of the invention provides a method for significantly 
improving clarity and data collection from slides stained with a plurality- of ^^tnin-^ 



. L I i > t ^ J k J 



with such stains. Recombinations of desired subsets of stains employed such as 
hematoxvHn and cosin, which arc traditionally co-used for stainine are also 
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obtainable. Thus any stain or subset of stains can be uncovered and displayed as 
if used by itself. This renders the images more amenable to the pathologists. 
However, the main importance of the present invention in this respect is that 
containing and stain resolution enables to view co-stained single cells, a feature 
not practiced by the prior art, especially when histological stains are used. This 
can provide a new horizon for the pathologist, who, so far, was accustomed, to 
use multiple slides and statistical analyses, to determine the level to which cells 
are stained by each of the stains employed. 



Although the invention has been 

— vt^iA^vivyti VYlLll i^pUL/iilC' 

embodiments thereof, it is evident that many alternatives, modifications and 
variations will be apparent to those skilled in the art. Accordingly, it is intended 
to embrace all such alternatives, modifications and variations that fall within the 
spirit and broad scope of the appended claims. 
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WHAT IS CLAIMED IS: 



1 . A method of in situ analysis of a biological sample comprising the 
steps of: 

(a) staining the biological sample with N stains of which a first stain is 
selected from the group consisting of a first immunohistochemical 
stain, a first histological stain and a first DNA ploidy stain, and a 
second stain is selected from the group consisting of a second 
immunohistochemical stain, a second histological stain and a 
second DNA ploidy stain, with provisions that N is an integer 
greater than three and further that: 

(i) if said first stain is said first immunohistochemical stain then 
said second stain is either said second histological stain or 
said second DNA ploidy stain; 

(ii) if said first stain is said first histological stain then said 
second stain is either said second immunohistochemical stain 
or said second DNA ploidy stain; whereas 

(iii) if said first stain is said first DNA ploidy stain then said 
second stain is either said second immunohistochemical stain 
or said second histological stain; and 

(b) using a spectral data collection device for collecting spectral data 
from said biological sample, said spectral data collection device and 
said N stains are selected such that a spectral component associated 
with each of said N stains is collectable. 

2. The method of claim 1, wherein said spectral data collection device 
is selected from the group consisting of an interferometer-based spectral data 
collection device, filters-based spectral data collection device and a dispersion 
element-based spectral data collection device. 

3. The method of claim 1. wherein ^aid fir^t inr1 ^^-nnH 



from the group consisting of anti-cstrogcn receptor antibody, anti-progesterone 
receptor antibody, anti-p53 antibodw anTiT4er-2'neu antibod\, anti^rGIT^ 
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antibody, anti-cathepsin D antibody, anti-Bcl-2 antibody, anti-E-cadherin 
antibody, anti-CA125 antibody, anti-CA15-3 antibody, anti-CA19-9 antibody, 
anti-c-erbB-2 antibody, anti-P-glycoprotein antibody, anti-CEA antibody, anti- 
retinoblastoma protein antibody, anti-ras oncoprotein antibody, anti-Lewis X 
antibody, anti-Ki-67 antibody, anti-PCNA antibody, anti-CD3 antibody, anti-CD4 
antibody, anti-CD5 antibody, anti-CD7 antibody, anti-CD8 antibody, anti- 
CD9/p24 antibody, anti-CDlO antibody, anti-CDllc antibody, anti-CD13 
antibody, anti-CDI4 antibody, anti-CD15 antibody, anti-CD19 antibody, anti- 
CD20 antibody, anti-CD22 antibody, anti-CD23 antibody, anti-CD30 antibody, 
anti-CD31 antibody, anti-CD33 antibody, anti-CD34 antibody, anti-CD35 
antibody, anti-CD38 antibody, anti-CD41 antibody, anti-LCAyCD45 antibody, 
anti-CD45RO antibody, anti-CD45RA antibody, anti-CD39 antibody, anti- 
CDIOO antibody, anti-CD95/Fas antibody, anti-CD99 antibody, anti-CD106 
antibody, anti-ubiquitin antibody, anti-CD71 antibody, anti-c-myc antibody, anti- 
cytokeratins antibody, anti-vimentins antibody, anti-HPV proteins antibody, anti- 
kappa light chains antibody, anti-lambda light chains antibody, anti-melanosomes 
antibody, anti-prostate specific antigen antibody, anti-S-100 antibody, anti-tau 
antigen antibody, anti-fibrin antibody, anti-keratins antibody and anti-Tn-antigen 
antibody. 

5. The method of claim 3, wherein said primary antibody is labeled 
with a detectable moiety. 

6. The method of claim 5, wherein said detectable moiety is a 
fluorescent dye. 

7. The method of claim 6, wherein said fluorescent dye is selected 
from the group consisting of Fluorescein, Rhodamine, Texas Red, Cy2, Cy3, 
Cy5, VECTOR Red, ELF^^ (Enzyme-Labeled Fluorescence), CyO, CyO.5, Cyl, 
Cyl.5, Cy3, Cy3.5, Cy5, Cy7, FluorX, Calcein, Calcein-AM, 
CRYPTOFLUOR™'S, Orange (42 kDa), Tangerine (35 kDa), Gold (31 kDa), 
Red (42 kDa), Crimson (40 kDa), BHMP, BHDMAP, Br-Oregon, Lucifer 
Yellow, Alexa dye family, N-f6-f7-nitrobenz-2-oxa-L 3-diazol-4- 



klJa), Spectrum Blue, Spectrum Aqua, Spectrum Green, Spectrum Gold. 
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Spectrum Orange, Spectrum Red, NADH, NADPH, FAD, Infra-Red (IR) Dyes, 
Cyclic GDP-Ribose (cGDPR), Calcofluor White, Tyrosine and Tryptophan. 

8. The method of claim 5, wherein said detectable moiety is a non- 
fluorescent dye. 

9. The method of claim 8, wherein said non-fluorescent dye includes a 
heavy metal. 



10. The. mpthnH nf r\ci\m < 

Tiiiwu^Aii ociiu uwLw^^Lauiu inuiCLy is all 



enzyme catalyzing a colorimetric reaction of a substrate having a substantially 
non-soluble color reaction product. 

11. The method of claim 10, wherein said enzyme is selected from the 
group consisting of alkaline phosphatase, horseradish peroxidase, [3- 
galactosidase, and glucose oxidase. 

12. The method of claim 10, wherein said substrate is selected from the 
group consisting of alkaline phosphatase substrates, horseradish 

I ~ — — " 

substrates, glucose oxidase substrates and beta-galactosidase substrates. 

13. The method of claim 5, wherein said detectable moiety is an 
enzyme catalyzing a luminescence reaction of a substrate having a substantially 
non-soluble reaction product capable of luminescencing or of chemical 
involvement in a second reaction with at least one additional substrate, said 
second reaction having a luminescencing product. 

14. The method of claim 13, wherein said enzyme is selected from the 
group consisting of alkaline phosphatase, horseradish peroxidase, P-galactosidase 
and glucose oxidase. 

15. The method of claim 13. wherein said first and at least one 
additional substrates are each independcntlv selected fmm the rrrnm cr^^^-^^uno nf 
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16. The method of claim 1, wherein said first and second 
immunohistochemical stains each independently includes a primary antibody and 
a signal amplification mechanism. 

17. The method of claim 16, wherein said signal amplification 
mechanism is selected from the group consisting of a secondary antibody capable 
of binding a constant region of said primary antibody, avidin or strepavidin 
capable of binding biotin conjugated to said primary antibody and biotin capable 
of binding avidin or strepavidin conjugated to said primary antibody. 

18. The method of claim 14, wherein said secondary antibody, avidin, 
strepavidin and biotin are each independently labeled with a detectable moiety. 

19. The method of claim 18, wherein said detectable moiety is a 
fluorescent dye. 

20. The method of claim 19, wherein said fluorescent dye is selected 
from the group consisting of Fluorescein, Rhodamine, Texas Red, Cy2, Cy3, 
Cy5, VECTOR Red, ELV^^ (Enzyme-Labeled Fluorescence), CyO, CyO.5. Cyl. 
Cyl.5, Cy3, Cy3.5, Cy5, Cy7, FluorX, Calcein, Calcein-AM, 
CRYPT0FLU0R™'S, Orange (42 kDa), Tangerine (35 kDa), Gold (3 1 kDa), 
Red (42 kDa), Crimson (40 kDa), BHMP, BHDMAP, Br-Oregon, Lucifer 
Yellow, Alexa dye family, N-[6-(7-nitrobenz-2-oxa-l, 3-diazol-4- 
yl)amino]caproyl] (NBD), BODIPYtm, boron dipyrromethene difluoride, Oregon 
Green, MITOTRACKER™ Red, DiOC7(3), DilCjg, Phycoerythrin, 
Phycobiliproteins BPE (240 kDa) RPE (240 kDa) CPC (264 kDa) APC (104 
kDa), Spectrum Blue, Spectrum Aqua, Spectrum Green, Spectrum Gold, 
Spectrum Orange, Spectrum Red, NADH, NADPH, FAD, Infra-Red (IR) Dyes, 
Cyclic GDP-Ribose (cGDPR), Calcofluor White, Tyrosine and Tryptophan. 



21. The method of claim 18, wherein said detectable moiety is a 
fluorescent dye. 



wo 00/31534 



PCT/US99/27000 



89 



23. The method of claim 18, wherein said detectable moiety is an 
enzyme catalyzing a colorimetric reaction of a substrate having. a substantially 
non-soluble color reaction product. 

24. The method of claim 23, wherein said enzyme is selected from the 
group consisting of alkaline phosphatase, horseradish peroxidase, p. 
galactosidase, and glucose oxidase. 

25. The method of claim 23, wherein said substrate is selected from the 

crouD cnnsistinp r>f oIL'olina r^Unr.^u^t — i . , 

" • c ~' -"""««"^ yiiu.3j^^uaia3c, ijuiscrauisn peroxidase, S- 

galactosidase, and glucose oxidase substrates. 

26. The method of claim 18, wherein said detectable moiety is an 
enzyme catalyzing a luminescence reaction of a substrate having a substantially 
non-soluble reaction product capable of luminescencing or of directing a second 
reaction of a second substrate having a luminescencing product. 

27. The method of claim 26, wherein said enzyme is selected from the 
group consisting of luciferase and aequorin. 

28. The method of claim 26, wherein said first and second substrates 
are each independently selected from the group consisting of luciferine, ATP, 
coelenterazine and Ca"^"*". 

29. The method of claim 1, wherein said first and second histological 
stains are each independently selected from the group consisting of 4',6- 
diamidino-2-phenylindo!e, Eosin, Fluorescein isothiocyanate, Hoechst 33258, 
Hoechst 33342, Propidium Iodide, Quinacrine, Fluorescein-phalloidin, Resorufm,' 
hematoxylin. Orange G, Light Green SF, Romanowsky-Giemsa, May-Grunwald! 
Blue counterstain, ethyl green, Feulgen-naphthol yellow S, Giemsa, Methylene 
Blue, Methyl Green, pyronin, Naphthol-yellow, Neutral Red, Papanicolaou stain. 
Red Counterstain C and Sirius Red. 



• M-iiiiav L'liiLicii iLMctiui;. .■Xuraiiiiuc U-l-culgcn 
reaction, Fthidium Bromide, Propidium iodide, high affinit}' DNA nuoropho^es. 
Green Fluorescent Protein fused to DN.A bir^dine t^rotcin. APMA n^micrv.- 
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and Acridine Orange, Feulgen reagent. Gallocyanin chrom-alum, Gallocyanin 
chrom-alum and naphthol yellow S, Methyl green-pyronin Y, and Thionin- 
Feulgen reagent. 

31. A method of in situ analysis of a biological sample comprising the 
steps of: 

(a) staining the biological sample with a plurality of stains of which a 
first stain is selected from the group consisting of a first 
immunohistochemical stain, a first histological stain and a first 
^.w. oiaul, aiiu d v;ccunG siaiH IS selcctcd trom the group 
consisting of a second immunohistochemical stain, a second 
histological stain and a second DNA ploidy stain, with a provision 
that: 

(i) if said tlrst stain is said first immunohistochemical stain then 
said second stain is either said second histological stain or 
said second DNA ploidy stain; 

(ii) if said first stain is said first histological stain then said 
second stain is either said second immunohistochemical stain 
or said second DNA ploidy stain; whereas 

(iii) if said first stain is said first DNA ploidy stain then said 
second stain is either said second immunohistochemical stain 
or said second histological stain; and 

(b) using a spectral data collection device for collecting spectral data 
from said biological sample, said spectral data collection device and 
said plurality of stains are selected such that a spectral component 
associated with each of said plurality of stains is collectable. 

32. The method of claim 31, wherein said spectral data collection 
device is selected from the group consisting of an interferometer-based spectral 
data collection device, filters-based spectral data collection device and a 
dispersion element-based spectral data collection device. 

The method of rln^TT ..i,..r.>;-^ ; j r.. , ^ 



.lie mcliiud vi ciaini .v), vMiciciii saia prinuir}^ antib()d\ is selected 
irom ihc group consisUng of anli-estrogcn receptor antibody, anti-progesterone 
receptor antibod^^ anti-p'^^ an!ibod\' a^w;_[ Jo^^^ ^r^i^ > ^ ,..t; jv^rT,^ 
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antibody, anti-cathepsin D antibody, anti-Bcl-2 antibody, anti-E-cadherin 
antibody, anti-CA125 antibody, anti-CA15-3 antibody, anti-CAJ9-9 antibody, 
anti-c-erbB-2 antibody, anti-P-glycoprotein antibody, anti-CEA antibody, anti- 
retinoblastoma protein antibody, anti-ras oncoprotein antibody, anti-Lewis X 
antibody, anti-Ki-67 antibody, anti-PCNA antibody, anti-CD3 antibody, anti-CD4 
antibody, anti-CD5 antibody, anti-CD7 antibody, anti-CD8 antibody, anti- 
CD9/p24 antibody, anti-CDlO antibody, anti-CDllc antibody, anti-CD13 
antibody, anti-CD 14 antibody, anti-CD 15 antibody, anti-CD 19 antibody, anti- 
CD20 antibody, anti-CD22 antibody, anti-CD23 antibody, anti-CD30 antibody, 
i^ww ^x^^i ttjjtiuwujr, aiiu-x^L/jj aimooay, anii-L-Ui4 antibody, anti-CD35 
antibody, anti-CD38 antibody, anti-CD41 antibody, anti-LCA/CD45 antibody, 
anti-CD45RO antibody, anti-CD45RA antibody, anti-CD39 antibody, anti- 
CD 100 antibody, anti-CD95/Fas antibody, anti-CD99 antibody, anti-CD 106 
antibody, anti-ubiquitin antibody, anti-CD71 antibody, anti-c-myc antibody, anti- 
cytokeratins antibody, anti-vimentins antibody, anti-HPV proteins antibody, anti- 
kappa light chains antibody, anti-lambda light chains antibody, anti-melanosomes 
antibody, anti-prostate specific antigen antibody, anti-S-100 antibody, anti-tau 
antigen antibody, anti-fibrin antibody, anti-keratins antibody and anti-Tn-antigen 
antibody. 

35. The method of claim 33, wherein said primary antibody is labeled 
with a detectable moiety. 

36. The method of claim 35, wherein said detectable moiety is a 
fluorescent dye. 

37. The method of claim 36, wherein said fluorescent dye is selected 
from the group consisting of Fluorescein, Rhodamine, Texas Red, Cy2, Cy3, 
Cy5, VECTOR Red, ELF™ (Enzyme-Labeled Fluorescence), CyO, CyO.5, Cyl, 
Cyl.5, Cy3, Cy3.5, Cy5, Cy7, FluorX, Calcein, Calcein-AM, 
CRYPTOFLUORTM'S, Orange (42 kDa), Tangerine (35 kDa), Gold (31 kDa), 
Red (42 kDa), Crimson (40 kDa), BHMP, BHDN4AP, Br-Oregon, Lucifer 
Yellow Alpxa d\'p f-imi'v v \r^ /"^ -w- ^^, — -> ... . > - • . i • 



r...'i^i.ijvoiciii.-, LU'h iJ-U,i kiJai Kl'L (i4i) kiJaj l l'c: (.^i()4 klJaj .W'L' (l(i4 
)a). Spectrum Blue. Spectrum .Aqua, Spectrum drcen. Spectrum (iohl. 
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Spectrum Orange, Spectrum Red, NADH, NADPH, FAD, Infra-Red (IR) Dyes 
Cyclic GDP-Ribose (cGDPR), Calcofluor White, Tyrosine and Tryptophan. 

38. The method of claim 35, wherein said detectable moiety is a non- 
fluorescent dye. 

39. The method of claim 38, wherein said non-fluorescent dye includes 
a heavy metal. 

...w K^icxLiiL j^, vYJiciciu bdiu ueteciaDie moiety is an 

enzyme catalyzing a colorimetric reaction of a substrate having a substantially 
non-soluble color reaction product. 

41. The method of claim 40, wherein said enzyme is selected from the 
group consisting of alkaline phosphatase, horseradish peroxidase, p- 
galactosidase, and glucose oxidase. 



42. The method of claim 40. wherein said <;iih<;tratp ic Qpl^^rtpH frrvrr^ fUo, 

group consisting of alkaline phosphatase substrates, horseradish peroxidase 
substrates, glucose oxidase substrates and beta-galactosidase substrates. 

43. The method of claim 35, wherein said detectable moiety is an 
enzyme catalyzing a luminescence reaction of a substrate having a substantially 
non-soluble reaction product capable of luminescencing or of chemical 
involvement in a second reaction with at least one additional substrate, said 
second reaction having a luminescencing product. 

44. The method of claim 43, wherein said enzyme is selected from the 
group consisting of alkaline phosphatase, horseradish peroxidase, P-galactosidase 
and glucose oxidase. 

4*^. The method nf dnim 4^ uJT-'-.'ir- ..-vri Tret .,. . 
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46. The method of claim 31, wherein said first and second 
immunohistochemical stains each independently includes a primaiy antibody and 
a signal amplification mechanism. 

47. The method of claim 46, wherein said signal amplification 
mechanism is selected from the group consisting of a secondary antibody capable 
of binding a constant region of said primary antibody, avidin or strepavidin 
capable of binding biotin conjugated to said primary antibody and biotin capable 
of binding avidin or strepavidin conjugated to said primary antibody. 

48. The method of claim 44, wherein said secondary antibody, avidin, 
strepavidin and biotin are each independently labeled with a detectable moiety. 

49. The method of claim 48, wherein said detectable moiety is a 
fluorescent dye. 

50. The method of claim 49, wherein said fluorescent dye is selected 
from the group consisting of Fluorescein, Rhodamine, Texas Red, Cy2, Cy3, 
Cy5, VECTOR Red, ELF^" (Enzyme-Labeled Fluorescence), CyO, CyO.s', Cyl,' 
Cyl.5, Cy3. Cy3.5, Cy5, Cy7. FluorX, Calcein, Calcein-ATvl' 
CRYPTOFLUOR^'S, Orange (42 kDa), Tangerine (35 kDa), Gold (31 kDa)! 
Red (42 kDa), Crimson (40 kDa), BHMP, BHDMAP, Br-Oregon, Lucifer 
Yellow, Alexa dye family, N-[6-(7-nitrobenz-2-oxa- 1 , 3-diazol-4- 
yl)amino]caproyl] (NBD), BODIPY™, boron dipyrromethene difluoride Oregon 
Green, MITOTRACKER™ Red, DiOC7(3), DilCig, Phycoerythrin 
Phycobihproteins BPE (240 kDa) RPE (240 kDa) CPC (264 kDa) APC (104 
kDa), Spectrum Blue, Spectrum Aqua, Spectrum Green, Spectrum Gold, 
Spectrum Orange, Spectrum Red, NADH, NADPH, FAD, Infra-Red (IR) Dyes' 
Cyclic GDP-Ribose (cGDPR), CalcoHuor White, Tyrosine and Tryptophan. 

51. The method of claim 48, wherein said detectable moiety is a non- 
fluorescent dye. 
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53. The method of claim 48, wherein said detectable moiety is an 
enzyme catalyzing a colorimetric reaction of a substrate having ^ substantially 
non-soluble color reaction product. 

54. The method of claim 53, wherein said enzyme is selected from the 
group consisting of alkaline phosphatase, horseradish peroxidase, p- 
galactosidase, and glucose oxidase. 

55. The method of claim 53, wherein said substrate is selected from the 
groun consisting of alkaline nho.snhata«;e. hor«;eraHi«;h nftroxidasf*. ^- 
galactosidase, and glucose oxidase substrates. 

56. The method of claim 48, wherein said detectable moiety is an 
enzyme catalyzing a luminescence reaction of a substrate having a substantially 
non-soluble reaction product capable of luminescencing or of directing a second 
reaction of a second substrate having a luminescencing product. 

57. The method of claim 56, wherein said enzyme is selected from the 
group consisting of luciferase and aequorin. 

58. The method of claim 56, wherein said first and second substrates 
are each independently selected from the group consisting of luciferine, ATP, 
coelenterazine and Ca"^"^. 

59. The method of claim 31, wherein said first and second histological 
stains are each independently selected from the group consisting of 4',6- 
diamidino-2-phenylindole, Eosin, Fluorescein isothiocyanate, Hoechst 33258, 
Hoechst 33342, Propidium Iodide, Quinacrine, Fluorescein-phalloidin, Resorufin, 
hematoxylin, Orange G, Light Green SF, Romanowsky-Giemsa, May-Grunwald, 
Blue counterstain, ethyl green, Feulgen-naphthol yellow S, Giemsa, Methylene 
Blue, Methyl Green, pyronin, Naphthol-yellow, Neutral Red, Papanicolaou stain, 
Red Counterstain C and Sirius Red. 



immunohistochemical stains; and 
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(b) using a spectral data collection device for collecting spectral data 
from said biological sample, said spectral data collection device and 
said at least four immunohistochemical stains are selected such that 
a spectral component associated with each of said at least four 
immunohistochemical stains is collectable. 

61. A method of in situ analysis of a biological sample comprising the 
steps of; 

(a) staining the biological sample with at least three stains of which at 
least one stain is an immunohistochemical stain and at 1ea5;t one 
additional stain is a histological stain or a DNA ploidy stain; and 

(b) using a spectral data collection device for collecting spectral data 
from said biological sample, said spectral data collection device and 
said at least three stains are selected such that a spectral component 
associated with each of said at least three stains is collectable. 

62. A method of in situ analysis of a biological sample comprising the 
steps of: 

(a) staining the biological sample with at least three stains of which a 
first stain is an immunohistochemical stain, a second stain is a 
histological stain and a third stain is a DNA ploidy stain; and 

(b) using a spectral data collection device for collecting spectral data 
from said biological sample, said spectral data collection device and 
said at least three stains are selected such that a spectral component 
specifically associated with each of said at least three stains is 
collectable. 

63. An immunohistochemical composition comprising at least four 
different immunohistochemical stains, each being for staining a respective 
cytological marker and each being individually detectable in a presence of all 
others using a spectral data collection device. 

64. A method of resolvine individual stain images from a biolocical 



from each pixel of the biological sample; 
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(b) calculating a calculated spectrum for each of said pixels and for 
each of the at least two independent stains, said calculated spectrum 
being equivalent to an actual spectrum that would have been 
measured using said spectral data collection device had the 
biological sample been individually stained with one of the at least 
two individual stains; 

(c) operating a displaying algorithm on each of said calculated spectra 
for displaying each of said pixels in a calculated artificial color 
being equivalent to an actual color that would have been perceived 

for ParVl Qf*i/^ niv^^Ic ncincr 5» mir^rr^crrvrv** V^ctA tK#» Ui/^l r*rri r^o] f;f»rrinlf*^ 

been individually stained with said one of the at least two individual 
stains. 

65. The method of claim 64, further comprising the step of: 

(d) recombining at least two of the individual stain images into a 
combined image being equivalent to an actual image that would 
have been perceived should said individual stain images respective 
stains would have been used for containing the biological sample 
and would have been viewed using a microscope. 

66. The method of claim 64, wherein said spectral data collection 
device is selected from the group consisting of an interferometer-based spectral 
data collection device, filters-based spectral data collection device and a 
dispersion element-based spectral data collection device. 

67. The method of claim 64, wherein the at least two independent 
stains are individually selected from the group consisting of an 
immunohistochemical stain, a histological stain and a DNA ploidy stain. 

68. The method of claim 64, wherein said calculated spectrum is 
effected by calculating an absorbance spectrum for each of said pixels for each of 
the at least two independent stains and then calculating a corresponding 
transmittance spectrum for each of said pixels for each of the at least nvo 



'. ' ■ . . 1 i L- i ] 1 L li V H i ^ ■ i i^. i L 1 1 ; 1 i ■ ' t'^ , ^ 'v i i iJ I L i 1 i I i 1 j \ .■ \ d I . I I L.1 1 , /I i 1 1 , 1, U 1 1 i i^' ^ ' i 1 1 R. 

biological sample stained with the at least two independent stains is expressed as 
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a sum of said corresponding transmittance spectra of the at least two independent 
stains. 

70. The method of claim 69, wherein each individual stain spectrum of 
the at least two independent stains is constructed by correlating the sum of said 
corresponding transmittance spectra with reference spectra of said at least two 
independent stains. 

71. A method of resolving individual stain images from a biological 
sample stained with at least two individual stains, the method comprising the 
steps of: 

(a) using a spectral data collection device for collecting spectral data 
from each pixel of the biological sample; 

(b) calculating a calculated spectrum for each of said pixels and for 
each of the at least two independent stains, said calculated spectrum 
being equivalent to an actual spectrum that would have been 
measured using said spectral data collection device had the 
biological sample been individually stained with one of the at least 
two individual stains: 

— — . „ . ^ ^ 

(c) operating a displaying algorithm on each of said calculated spectra 
for displaying each of said pixels in a calculated artificial color 
being equivalent to an actual color of an equivalent additional stain 
as would have been perceived for each of said pixels using a 
microscope had the biological sample been individually stained 
with said additional stain. 
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Special citcgoncj of ciicd documcnu: 

document defining the general sUte of the an which ii noi considered 
to be of particulir rclevincc 

earlier document published on or after the inicmaiional filing [late 

document which may throw doubti on pnonry clBim(s) or which is 
ciicd 10 establish the publication date of another citation or other 
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later document published after the international filing date or pnonry 
dale and not in conflict with the application but cited to undcntand the 
principle or theory underlying the invention 

document of panicular relevance; the claimed invention cannot be 
considered novel or cannot be considered to mvolvc an mvcniivc step 
when the document is taken alone 

'^'^aImenl of nanicular relevance: the claimed irvcnlinn cannoi be 
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